-- Logs begin at Fri 2022-06-03 15:30:32 UTC, end at Fri 2022-06-03 16:43:26 UTC. -- Jun 03 16:12:12.675496 dv-cinder-836996-28-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 03 16:12:12.684937 dv-cinder-836996-28-smb devstack@keystone.service[80211]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 16:12:12 2022] *** Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: nodename: dv-cinder-836996-28-smb Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: machine: x86_64 Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: clock source: unix Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: pcre jit disabled Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: detected number of CPU cores: 4 Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: current working directory: / Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: detected binary path: /usr/bin/uwsgi-core Jun 03 16:12:12.686950 dv-cinder-836996-28-smb devstack@keystone.service[80211]: your processes number limit is 47680 Jun 03 16:12:12.687617 dv-cinder-836996-28-smb devstack@keystone.service[80211]: your memory page size is 4096 bytes Jun 03 16:12:12.687617 dv-cinder-836996-28-smb devstack@keystone.service[80211]: detected max file descriptor number: 2048 Jun 03 16:12:12.687617 dv-cinder-836996-28-smb devstack@keystone.service[80211]: lock engine: pthread robust mutexes Jun 03 16:12:12.687617 dv-cinder-836996-28-smb devstack@keystone.service[80211]: thunder lock: enabled Jun 03 16:12:12.687617 dv-cinder-836996-28-smb devstack@keystone.service[80211]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 03 16:12:12.687617 dv-cinder-836996-28-smb devstack@keystone.service[80211]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 16:12:12.732841 dv-cinder-836996-28-smb devstack@keystone.service[80211]: Python main interpreter initialized at 0x5574f5f4f9c0 Jun 03 16:12:12.732841 dv-cinder-836996-28-smb devstack@keystone.service[80211]: python threads support enabled Jun 03 16:12:12.732841 dv-cinder-836996-28-smb devstack@keystone.service[80211]: your server socket listen backlog is limited to 100 connections Jun 03 16:12:12.732841 dv-cinder-836996-28-smb devstack@keystone.service[80211]: your mercy for graceful operations on workers is 90 seconds Jun 03 16:12:12.733218 dv-cinder-836996-28-smb devstack@keystone.service[80211]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 16:12:12.733296 dv-cinder-836996-28-smb devstack@keystone.service[80211]: *** Operational MODE: preforking *** Jun 03 16:12:12.733544 dv-cinder-836996-28-smb devstack@keystone.service[80211]: *** uWSGI is running in multiple interpreter mode *** Jun 03 16:12:12.733544 dv-cinder-836996-28-smb devstack@keystone.service[80211]: spawned uWSGI master process (pid: 80211) Jun 03 16:12:12.733747 dv-cinder-836996-28-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 03 16:12:12.738050 dv-cinder-836996-28-smb devstack@keystone.service[80211]: spawned uWSGI worker 1 (pid: 80221, cores: 1) Jun 03 16:12:12.738050 dv-cinder-836996-28-smb devstack@keystone.service[80211]: spawned uWSGI worker 2 (pid: 80222, cores: 1) Jun 03 16:12:12.738050 dv-cinder-836996-28-smb devstack@keystone.service[80211]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 16:12:18.415768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:12:18.415768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: from cryptography.utils import int_from_bytes Jun 03 16:12:18.416559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:12:18.416559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: from cryptography.utils import int_from_bytes Jun 03 16:12:18.416736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:12:18.416736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: from cryptography.utils import int_from_bytes Jun 03 16:12:18.417190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:12:18.417190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: from cryptography.utils import int_from_bytes Jun 03 16:12:18.465819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 16:12:18.465973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 16:12:18.466118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] command line args: [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 16:12:18.466364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 16:12:18.466504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 16:12:18.466593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ================================================================================ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 16:12:18.466700 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 16:12:18.466789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] admin_token = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.466895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] command line args: [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 16:12:18.467009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] config_dir = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.467166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 16:12:18.467251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.467333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ================================================================================ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 16:12:18.467406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] config_source = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.467525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] debug = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.467641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] admin_token = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.467748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] config_dir = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] config_source = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] debug = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468874 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.468984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.469177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.469177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] log_config_append = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.469354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.469464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.469568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.469671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] log_dir = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.469671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] log_file = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.469860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.469860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] log_config_append = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.470089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.470168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.470830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.470908 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] log_dir = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] log_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471668 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471801 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.471973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.472947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.473064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.473172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.473259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.473445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.473535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.473707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.473938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.112/identity {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.474060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.474148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] publish_errors = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.474223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.474340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.474550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.474692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.112/identity {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.474782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.474861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] publish_errors = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.474991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.475091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.475172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.475293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.475437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] standard_threads = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.475505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.475635 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.475718 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.475875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.475959 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476174 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] standard_threads = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] use_journal = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] use_json = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] use_stderr = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] use_syslog = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.476976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] use_journal = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.477146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.477232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] use_json = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.477305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] use_stderr = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.477382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.477479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] use_syslog = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.477622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.477702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:12:18.477860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.477939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.478106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.478241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.478325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.478428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.478574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.478654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.478808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.478965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.479043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.479137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.479289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.479389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.479536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.479649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.479781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.479896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.480021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.480147 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.480254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.480396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.480499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.480632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.480744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.480873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.480978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.481104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.481235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.481354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.481487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.481603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.481728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.481845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.481960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.482355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.482469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.482614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.482729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.482860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.482980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.483098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.483227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.483352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.483457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.483635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.483730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.483894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.483974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.484144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.484222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.484376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.484455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.484609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.484690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.484836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.484921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.485073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.485148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.485296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.485377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.485542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.485620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.485775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.485855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.486031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.486109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.486258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.486349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.486490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.486570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.486722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.486801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.486951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.487041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.487180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.487260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.487407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.487487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.487657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.487752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.487893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.487979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.488125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.488203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.488353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.488440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.488587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.488676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.488811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.488890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.489042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.489130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.489276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.489357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.489518 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.489630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.489728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.489831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.489963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.490100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.490219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.490329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.490435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.490524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.490645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.490722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.490839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.490916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.491067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.491159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.491320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.491401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.491570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.491666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.491813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.491902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.492040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.492133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.492290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.492370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.492521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.492601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.492750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.492872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.492982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.493063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.493211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.493292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.493474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.493562 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.493707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.493786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.493946 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.494019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.494183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.494269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.494416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.494496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.494647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.494733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.494877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.494966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.495120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.495211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.495352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.495442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.495613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.495709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.495852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.495932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.496084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.496169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.496315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.496467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.496543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.496615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.496764 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.496850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.496994 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.497076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.497234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.497312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.497470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.497548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.497705 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.497784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.497934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.498014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.498169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.498249 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.498400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.498481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.498629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.498709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.498860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.498939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.499085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.499175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.499311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.499392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.499537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.499639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.499789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.499879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.500016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.500098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.500248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.500317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.500477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.500545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.500713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.500791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.500943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.501022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.501181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.501260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.501437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.501518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.501690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.501776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.501920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.external = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.502000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.502149 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.502231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.502422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.502501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.502658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.502737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.502885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.password = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.502993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.external = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.503112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] auth.token = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.503195 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.503345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.503425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.503594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.503679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.503840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.503923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.password = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.504066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.504147 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.token = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.504310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.504398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.504547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.504626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.504770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.504855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.505000 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.505093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.505244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.505330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.505488 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.505569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.505717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.505808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.505952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.506032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.506191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.506271 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.506422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.506514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.506676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.506756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.506914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.507001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.507146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.507235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.507384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.507463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.507669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.507754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.507923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.508015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.508159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.508239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.508407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.508487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.508660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.508748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.508890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.508978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.509122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.509202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.509363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.509452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.509607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.509687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.509835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.509915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.510077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.510238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.510316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.510389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.510547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.510629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.510781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.510870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.511029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.511109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.511266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.511345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.511509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.511622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.511765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.511847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.512008 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.512090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.512247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.512341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.512477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.512557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.512708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.512789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.512953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.513042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.513181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.513261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.513413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.513495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.513649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.513738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.513895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.513975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.514125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.514206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.514361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.514458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.514575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.514657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.514815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.514896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.515059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.515141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.515290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.515370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.515523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.515683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.515794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.515877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.516044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.516126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.516284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.516363 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.516518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.516600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.516745 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.516826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.516979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.517545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.517724 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.517861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.517942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.518106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.518187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.518344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.518433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.518588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.518669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.518824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.518906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.519064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.519153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.519308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.519389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.519537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.519633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.519803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.519897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.520047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.520126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.520272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.520358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.520506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.520595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.520734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.520824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.520968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.521049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.521206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.521294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.521442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.521523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.521675 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.521755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.521909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.521998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.522152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.522234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.522394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.522476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.522619 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.522706 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.522846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.522927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.523089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.523169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.523331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.523419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.523600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.523685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.523818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.523899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.524050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.524143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.524276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.524357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.524510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.524591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.524765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.524893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.525003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.525126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.525241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.525373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.525474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.525620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.525702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.525867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.526089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.526170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.526316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.526404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.526549 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.526631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.526782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.526863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.527016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.527098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.527244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.527325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.527488 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.527582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.527756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.527840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.527993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.528072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.528235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.528471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.528554 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.528695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.528774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.528939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.529020 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.529171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.529254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.529404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.529485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.529636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.529716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.529868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.529950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.530109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.530189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.530353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.530434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.530588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.530671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.530824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.530904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.531053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.531132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.531298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.531381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.531530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.531644 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.531782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.531863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.532015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.532098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.532260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.532339 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.532499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.532580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.532796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.533394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.533546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.533626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.533782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.533861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.534032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.534115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.534276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.534362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.534510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.534590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.534748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.534831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.534992 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.535073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.535223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.535302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.535467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.535570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.535728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.535809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.535963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.536044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.536196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] role.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.536279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.536439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] role.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.536520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.536668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.536750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.536914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.536995 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.537154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.537234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.537391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] role.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.537471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.537632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.537713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] role.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.537864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.537944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.538107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.538186 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.538350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.538433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.538597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.538677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.538826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.538907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.539070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.539153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.539315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.539396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.539594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.539692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.539830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.539910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.540068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.540233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.540313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.540467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.540549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.540715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.540796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.540963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.541044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.541213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.541428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.541509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.541667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.541747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.541914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.542002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.542164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.542245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.542401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.542482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.542629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.542719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.542859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.542940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.543086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.543167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.543333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.543422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.543610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.543728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.543843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.543919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.544075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.544165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.544307 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.544387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.544531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.544610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.544761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] token.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.544850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.544992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.545073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.545234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.545315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.545466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.545549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.545710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.545790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.545948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] token.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.546029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.546177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.546259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.546417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.546498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.546655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.546735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.546897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.546978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.547130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.547211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.547361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.547441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.547612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.547697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.547855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.547936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.548102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.548238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.548358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.548436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.548589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.548671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.548828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.548909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.549077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.549160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.549327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.549418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.549563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.549645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.549804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.549883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.550039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.550122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.550270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.550352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.550503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.550594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.550735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.550825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.550968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.551050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.551212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.551294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.551445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.551535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.551709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.551792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.551940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.552021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.552186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.552283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.552419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.552502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.552661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.552742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.552893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.553052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.553132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.553205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.553354 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.553434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.553508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 16:12:18.553591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.553824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.554059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.554302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.554540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:12:18.554711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 16:12:18.583249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.583474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.583721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.583862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.584123 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.584331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.592278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.592980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.622384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.622622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.623110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.623347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.679037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.679305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.730764 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.730971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.731062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.731218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.802967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.803193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.803366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.803478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.803624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.803761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.803893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.804007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.804114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.804238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.804238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.804466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.828168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.828387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.828570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.828664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.828789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.828875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.828999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.829096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.829208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.829293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.829417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.829501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.829674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.829894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.841728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.841920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.855436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.855681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.855773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.855898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.855987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.856118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.856208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.856331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.856416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.856544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.856661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.856767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80221) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.856914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.857311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 16:12:18.875234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.875501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 16:12:18.875678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.875859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.876002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 16:12:18.876149 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 16:12:18.876291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.876492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.876635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 16:12:18.876790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.876931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.877077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.877214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.877351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.877504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.877504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.887992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.888267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.888502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.888590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.888784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.888870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.889059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.889343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.896915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.897545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.900190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.900467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.900743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.900861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.901017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.901143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.901292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.901425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.901668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.901749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.901938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.902021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.902223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.902348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.902492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.902626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.902763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.902905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.903026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.903218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.903467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.903772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.930685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.932461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.932738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.932877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.934534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.934814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.938007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.938287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.938563 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.940192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.940483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.940763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.945899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.946183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.948190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.948470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.950639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.951039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.951317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.951614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.951888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.952157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.952419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.952681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.953016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.953423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.953713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.953994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.954273 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.954576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.954853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.955124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.971585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.971855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.974265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.974556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.976454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.979180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.980097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.980323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.983155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.983394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.985505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.989010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.989632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.992615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:18.994807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.995103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.995387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.995699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.995981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.996257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.997909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.998211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.998500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.998788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.999070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:18.999351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.015099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.015380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.015673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.015944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.018577 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.018872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.019139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.019420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.023880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.025582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.025851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.027487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.028939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.029211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.029314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.029499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.029594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.029774 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.030063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.032555 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.033379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.033660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.033939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.034226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.043942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.044228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.044507 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.044781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.045053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.045323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.045592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.047806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.048094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.048431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.049217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.049500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.049773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.050045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.064844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.068108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.068852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.071370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.072158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.072985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.074610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.074883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.075156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.075477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.077107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.078761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.079038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.079320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.083106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.084759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.087357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.087921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.088208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.088485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.088756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.089019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.092303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.092590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.092873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.093148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.097833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.098115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.098497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.102328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.102626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.103019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.106368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80221) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.106642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.106913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.107443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.107749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.108042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.108318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.108601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.108864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.109124 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.109387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.109654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.109917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.110175 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80221) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.111974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 16:12:19.112256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.112537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.112812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.113081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.113384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.113669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.113944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.114214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.114482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.114750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.115019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.115289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.115577 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 16:12:19.148675 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5574f5f4f9c0 pid: 80221 (default app) Jun 03 16:12:19.152081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82829fb-d926-461b-8020-ca3f2cbae1ba None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:19.152369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82829fb-d926-461b-8020-ca3f2cbae1ba None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:19.152643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82829fb-d926-461b-8020-ca3f2cbae1ba None None] PATH_INFO: `/v3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:19.154036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5574f5f4f9c0 pid: 80222 (default app) Jun 03 16:12:19.156957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1/1] 10.222.0.112 () {50 vars in 796 bytes} [Fri Jun 3 16:12:19 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:27.207435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15732251-01cb-43b4-80f4-e43b57326490 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:27.208044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15732251-01cb-43b4-80f4-e43b57326490 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:27.208044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15732251-01cb-43b4-80f4-e43b57326490 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:27.212435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1/2] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:27 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:12:27.218078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:27.218543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:27.218732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:27.287233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: INFO dbcounter [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] Registered counter for database keystone Jun 03 16:12:27.308629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG oslo_db.sqlalchemy.engines [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:12:27.315216 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writer thread running {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:12:27.601624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG passlib.handlers.bcrypt [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80221) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 16:12:27.601959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG passlib.handlers.bcrypt [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80221) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 16:12:27.665889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:27.667490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:27.793738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 2/3] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:27 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 577 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 03 16:12:27.948874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15732251-01cb-43b4-80f4-e43b57326490 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:28.018310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: INFO dbcounter [None req-15732251-01cb-43b4-80f4-e43b57326490 None None] Registered counter for database keystone Jun 03 16:12:28.038008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG oslo_db.sqlalchemy.engines [None req-15732251-01cb-43b4-80f4-e43b57326490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:12:28.044207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writer thread running {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:12:28.270950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15732251-01cb-43b4-80f4-e43b57326490 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:28.275575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f057e-1ebc-4d5f-8451-62a2411a24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:28.276256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f057e-1ebc-4d5f-8451-62a2411a24c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:28.276546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f057e-1ebc-4d5f-8451-62a2411a24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:28.276828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f057e-1ebc-4d5f-8451-62a2411a24c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:28.286317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f057e-1ebc-4d5f-8451-62a2411a24c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:28.338082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b87f057e-1ebc-4d5f-8451-62a2411a24c8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 16:12:28.338419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f057e-1ebc-4d5f-8451-62a2411a24c8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:28.349361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 2/4] 10.222.0.112 () {58 vars in 1329 bytes} [Fri Jun 3 16:12:27 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 16:12:28.355461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:28.370761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf88d93-95fe-4c77-b5dd-38f1d2fe31be None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:28.375276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e9cd0-831c-4183-bb34-8fd96094ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:28.376492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9cd0-831c-4183-bb34-8fd96094ce46 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:28.376781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9cd0-831c-4183-bb34-8fd96094ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:28.377061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9cd0-831c-4183-bb34-8fd96094ce46 admin admin] PATH_INFO: `/v3/projects/927da6a6fca54cd4babce7d6546e8b7f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:28.378598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e9cd0-831c-4183-bb34-8fd96094ce46 admin admin] RBAC: Authorizing `identity:get_project(project_id=927da6a6fca54cd4babce7d6546e8b7f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:28.430837 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WARNING keystone.common.rbac_enforcer.enforcer [None req-860e9cd0-831c-4183-bb34-8fd96094ce46 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 16:12:28.431186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e9cd0-831c-4183-bb34-8fd96094ce46 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:28.435925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 3/5] 10.222.0.112 () {56 vars in 1212 bytes} [Fri Jun 3 16:12:28 2022] GET /identity/v3/projects/927da6a6fca54cd4babce7d6546e8b7f => generated 345 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:30.657348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc2e8f-c141-4952-80ed-860b70283779 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:30.657891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc2e8f-c141-4952-80ed-860b70283779 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:30.658011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc2e8f-c141-4952-80ed-860b70283779 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:30.662588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 3/6] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:30 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:12:30.668675 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf81b4-07c9-4dd8-94fe-a98833736c23 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:30.669146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf81b4-07c9-4dd8-94fe-a98833736c23 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:30.669235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf81b4-07c9-4dd8-94fe-a98833736c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:30.688108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-42cf81b4-07c9-4dd8-94fe-a98833736c23 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:30.689651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-42cf81b4-07c9-4dd8-94fe-a98833736c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:30.697535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 4/7] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:30 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 03 16:12:30.721885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc2e8f-c141-4952-80ed-860b70283779 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:30.736128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc2e8f-c141-4952-80ed-860b70283779 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:30.740397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8649e4c-0d95-4bd8-88cd-a82b2d443357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:30.741037 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8649e4c-0d95-4bd8-88cd-a82b2d443357 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:30.741324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8649e4c-0d95-4bd8-88cd-a82b2d443357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:30.741610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8649e4c-0d95-4bd8-88cd-a82b2d443357 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:30.749384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8649e4c-0d95-4bd8-88cd-a82b2d443357 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:30.751699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8649e4c-0d95-4bd8-88cd-a82b2d443357 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:30.761417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 4/8] 10.222.0.112 () {58 vars in 1329 bytes} [Fri Jun 3 16:12:30 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:12:30.767803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf81b4-07c9-4dd8-94fe-a98833736c23 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:30.777011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf81b4-07c9-4dd8-94fe-a98833736c23 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:30.781504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0e042-3e2d-427e-adee-589c1df7fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:30.782372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e042-3e2d-427e-adee-589c1df7fe61 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:30.782658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e042-3e2d-427e-adee-589c1df7fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:30.782939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0e042-3e2d-427e-adee-589c1df7fe61 admin admin] PATH_INFO: `/v3/users/6a0908b00117426e8a0fae922d56155e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:30.784364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0e042-3e2d-427e-adee-589c1df7fe61 admin admin] RBAC: Authorizing `identity:get_user(user_id=6a0908b00117426e8a0fae922d56155e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:30.786195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0e042-3e2d-427e-adee-589c1df7fe61 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:30.787797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 5/9] 10.222.0.112 () {56 vars in 1203 bytes} [Fri Jun 3 16:12:30 2022] GET /identity/v3/users/6a0908b00117426e8a0fae922d56155e => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:33.100961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6bb8a-8813-489c-ac9f-8551ef559307 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.101509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6bb8a-8813-489c-ac9f-8551ef559307 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.101509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6bb8a-8813-489c-ac9f-8551ef559307 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.102869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 5/10] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:33.108500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187d88-6869-4679-ba61-a9cbc11ba289 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.108908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187d88-6869-4679-ba61-a9cbc11ba289 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.109062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187d88-6869-4679-ba61-a9cbc11ba289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.117402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45101123-4fcb-403e-88fd-644bf5220ac8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.117688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45101123-4fcb-403e-88fd-644bf5220ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.117966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45101123-4fcb-403e-88fd-644bf5220ac8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.119291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 6/11] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:12:33.124550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8bac0-c43d-4dd8-af18-5730a3f8e28e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.124840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8bac0-c43d-4dd8-af18-5730a3f8e28e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.125122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8bac0-c43d-4dd8-af18-5730a3f8e28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.127122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a7187d88-6869-4679-ba61-a9cbc11ba289 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:33.128338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a7187d88-6869-4679-ba61-a9cbc11ba289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:33.168423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG passlib.handlers.bcrypt [None req-c2d8bac0-c43d-4dd8-af18-5730a3f8e28e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80222) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 16:12:33.168854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG passlib.handlers.bcrypt [None req-c2d8bac0-c43d-4dd8-af18-5730a3f8e28e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80222) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 16:12:33.211824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 6/12] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:33.215480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c2d8bac0-c43d-4dd8-af18-5730a3f8e28e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:33.217126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c2d8bac0-c43d-4dd8-af18-5730a3f8e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:33.236430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7187d88-6869-4679-ba61-a9cbc11ba289 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:33.260150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:33.319018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 7/13] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:33.340748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8bac0-c43d-4dd8-af18-5730a3f8e28e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:33.348193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7187d88-6869-4679-ba61-a9cbc11ba289 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:33.382125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977775b8-0f6a-435e-8a02-ee7ff0342a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:33.382929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977775b8-0f6a-435e-8a02-ee7ff0342a21 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.383199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977775b8-0f6a-435e-8a02-ee7ff0342a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.383478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977775b8-0f6a-435e-8a02-ee7ff0342a21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.395148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977775b8-0f6a-435e-8a02-ee7ff0342a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-977775b8-0f6a-435e-8a02-ee7ff0342a21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:33.406222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:33.407870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:12:33.408918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 7/14] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:12:33.413821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977775b8-0f6a-435e-8a02-ee7ff0342a21 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:33.443417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8bac0-c43d-4dd8-af18-5730a3f8e28e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:33.445719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:33.482395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b754a6-687c-4034-b6d4-aaba6cf4d73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:33.483294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b754a6-687c-4034-b6d4-aaba6cf4d73d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.483611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b754a6-687c-4034-b6d4-aaba6cf4d73d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.483902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b754a6-687c-4034-b6d4-aaba6cf4d73d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.496819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:33.515353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977775b8-0f6a-435e-8a02-ee7ff0342a21 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:33.552421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2b1c7-0a62-4948-9376-35ebe8dd8009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:33.553098 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2b1c7-0a62-4948-9376-35ebe8dd8009 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.553379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2b1c7-0a62-4948-9376-35ebe8dd8009 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.553663 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2b1c7-0a62-4948-9376-35ebe8dd8009 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.554436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2b1c7-0a62-4948-9376-35ebe8dd8009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:33.554554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b754a6-687c-4034-b6d4-aaba6cf4d73d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:33.554751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2b1c7-0a62-4948-9376-35ebe8dd8009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:33.556082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b754a6-687c-4034-b6d4-aaba6cf4d73d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:33.556190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2b1c7-0a62-4948-9376-35ebe8dd8009 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:33.569518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 8/15] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:33.575086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2b1c7-0a62-4948-9376-35ebe8dd8009 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:33.654538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 8/16] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:12:33 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 16:12:33.660039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b754a6-687c-4034-b6d4-aaba6cf4d73d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:33.662775 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:33.678042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2b1c7-0a62-4948-9376-35ebe8dd8009 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:33.712096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e0271-7adb-4a69-b2a1-23f0f1afefbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:33.712967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e0271-7adb-4a69-b2a1-23f0f1afefbc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.713246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e0271-7adb-4a69-b2a1-23f0f1afefbc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.713520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e0271-7adb-4a69-b2a1-23f0f1afefbc None admin] PATH_INFO: `/v3/users/6a0908b00117426e8a0fae922d56155e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.714713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e0271-7adb-4a69-b2a1-23f0f1afefbc None admin] RBAC: Authorizing `identity:get_user(user_id=6a0908b00117426e8a0fae922d56155e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:33.716212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e0271-7adb-4a69-b2a1-23f0f1afefbc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:33.718001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 9/17] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:33 2022] GET /identity/v3/users/6a0908b00117426e8a0fae922d56155e => generated 248 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:33.723126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e0271-7adb-4a69-b2a1-23f0f1afefbc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:33.741674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:33.763116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b754a6-687c-4034-b6d4-aaba6cf4d73d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:33.796732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae13fa-ef7b-4c35-b297-2f2245d0649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:33.797519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae13fa-ef7b-4c35-b297-2f2245d0649a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.797807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae13fa-ef7b-4c35-b297-2f2245d0649a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.798708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae13fa-ef7b-4c35-b297-2f2245d0649a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.818110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae13fa-ef7b-4c35-b297-2f2245d0649a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:33.819622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae13fa-ef7b-4c35-b297-2f2245d0649a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:33.828376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e0271-7adb-4a69-b2a1-23f0f1afefbc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-04ae13fa-ef7b-4c35-b297-2f2245d0649a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:12:33.840312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:33.841185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:33.842018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:12:33.842018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:12:33.842018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:12:33.842018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:33.842018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 9/18] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:12:33.847902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae13fa-ef7b-4c35-b297-2f2245d0649a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:33.863938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63b18c-3d6f-41c0-ab1c-d80426a9729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:33.864735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63b18c-3d6f-41c0-ab1c-d80426a9729d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.865019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63b18c-3d6f-41c0-ab1c-d80426a9729d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.865297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63b18c-3d6f-41c0-ab1c-d80426a9729d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.866533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63b18c-3d6f-41c0-ab1c-d80426a9729d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:33.868050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63b18c-3d6f-41c0-ab1c-d80426a9729d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:33.869646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 10/19] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:33.875313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63b18c-3d6f-41c0-ab1c-d80426a9729d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:33.903643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:33.947792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae13fa-ef7b-4c35-b297-2f2245d0649a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:33.954551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:33.974363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63b18c-3d6f-41c0-ab1c-d80426a9729d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:33.981530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d416db-c7c0-4c40-9f22-250ffc34f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:33.982449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d416db-c7c0-4c40-9f22-250ffc34f896 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:33.982740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d416db-c7c0-4c40-9f22-250ffc34f896 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:33.983015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d416db-c7c0-4c40-9f22-250ffc34f896 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:33.983766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d416db-c7c0-4c40-9f22-250ffc34f896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:33.984075 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d416db-c7c0-4c40-9f22-250ffc34f896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:33.986621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d416db-c7c0-4c40-9f22-250ffc34f896 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:34.003579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 10/20] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:12:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:34.008624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cef9b3-6fb6-4925-a806-f8baddd721bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:34.009310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef9b3-6fb6-4925-a806-f8baddd721bd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:34.009597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef9b3-6fb6-4925-a806-f8baddd721bd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:34.009877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef9b3-6fb6-4925-a806-f8baddd721bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:34.010738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cef9b3-6fb6-4925-a806-f8baddd721bd None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.domain.id=default, user.id=6a0908b00117426e8a0fae922d56155e) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:34.011055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cef9b3-6fb6-4925-a806-f8baddd721bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:34.012612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cef9b3-6fb6-4925-a806-f8baddd721bd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:34.020688 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 11/21] 10.222.0.112 () {56 vars in 1327 bytes} [Fri Jun 3 16:12:33 2022] GET /identity/v3/role_assignments?user.id=6a0908b00117426e8a0fae922d56155e&scope.domain.id=default&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 234 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:36.839375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466e06f-6768-40b2-b6c3-80a2244f9254 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:36.840430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466e06f-6768-40b2-b6c3-80a2244f9254 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:36.840940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466e06f-6768-40b2-b6c3-80a2244f9254 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:36.842799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 11/22] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:36 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:36.848501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c70f0a-6b3b-4dfd-8a72-583a168f685a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:36.848974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c70f0a-6b3b-4dfd-8a72-583a168f685a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:36.849050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c70f0a-6b3b-4dfd-8a72-583a168f685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:36.855736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed225a0-232c-4432-8336-75ab5fff717b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:36.856298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed225a0-232c-4432-8336-75ab5fff717b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:36.856780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed225a0-232c-4432-8336-75ab5fff717b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:36.858614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 12/23] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:12:36.864081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f202b-a660-4c28-a6e3-73d7997aca3d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:36.864610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f202b-a660-4c28-a6e3-73d7997aca3d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:36.865107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f202b-a660-4c28-a6e3-73d7997aca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:36.871939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-65c70f0a-6b3b-4dfd-8a72-583a168f685a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:36.874419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-65c70f0a-6b3b-4dfd-8a72-583a168f685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:36.907108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b47f202b-a660-4c28-a6e3-73d7997aca3d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:36.911493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b47f202b-a660-4c28-a6e3-73d7997aca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:37.026389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 12/24] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:37.029098 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133c21c-24e6-4b91-9bd1-1bd6edf5abf2 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:37.032250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133c21c-24e6-4b91-9bd1-1bd6edf5abf2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:37.032783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133c21c-24e6-4b91-9bd1-1bd6edf5abf2 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:37.036016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 13/25] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:37 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:37.040532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6658d-815b-443c-9723-b52dd4eb774f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:37.041082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6658d-815b-443c-9723-b52dd4eb774f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:37.041554 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6658d-815b-443c-9723-b52dd4eb774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:37.060838 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 13/26] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:37.066887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f202b-a660-4c28-a6e3-73d7997aca3d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:37.077006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1ce6658d-815b-443c-9723-b52dd4eb774f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:37.078539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1ce6658d-815b-443c-9723-b52dd4eb774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:37.158782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:37.200601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 14/27] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:37.203304 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6658d-815b-443c-9723-b52dd4eb774f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:37.212147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:37.297516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f202b-a660-4c28-a6e3-73d7997aca3d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:37.338111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6658d-815b-443c-9723-b52dd4eb774f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:37.384890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17dcfb-6d16-4637-b704-0221e1f08459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:37.385926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17dcfb-6d16-4637-b704-0221e1f08459 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:37.386407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17dcfb-6d16-4637-b704-0221e1f08459 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:37.386902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17dcfb-6d16-4637-b704-0221e1f08459 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:37.387886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17dcfb-6d16-4637-b704-0221e1f08459 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:37.389509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17dcfb-6d16-4637-b704-0221e1f08459 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:37.464396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3aca6-d11b-4a30-a9b4-4584837f3da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:37.465173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3aca6-d11b-4a30-a9b4-4584837f3da9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:37.465472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3aca6-d11b-4a30-a9b4-4584837f3da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:37.465753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3aca6-d11b-4a30-a9b4-4584837f3da9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:37.513002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3aca6-d11b-4a30-a9b4-4584837f3da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d9d3aca6-d11b-4a30-a9b4-4584837f3da9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:37.531601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:37.533137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:37.534036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:37.537362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 14/28] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:12:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 471 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:12:37.538401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3aca6-d11b-4a30-a9b4-4584837f3da9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:37.553342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 15/29] 10.222.0.112 () {60 vars in 1136 bytes} [Fri Jun 3 16:12:37 2022] POST /identity/v3/roles => generated 220 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:12:37.559868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17dcfb-6d16-4637-b704-0221e1f08459 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:37.656867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:37.725542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17dcfb-6d16-4637-b704-0221e1f08459 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:37.770061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d8a82-02db-4693-b284-1966b2ca6c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:37.771808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8a82-02db-4693-b284-1966b2ca6c43 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:37.772348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8a82-02db-4693-b284-1966b2ca6c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:37.772824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8a82-02db-4693-b284-1966b2ca6c43 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:37.773985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d8a82-02db-4693-b284-1966b2ca6c43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:37.774526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d8a82-02db-4693-b284-1966b2ca6c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:37.776372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d8a82-02db-4693-b284-1966b2ca6c43 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:37.788005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 16/30] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:37.791302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94432d9-4540-4d2b-aaea-199699325469 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:37.791885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94432d9-4540-4d2b-aaea-199699325469 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:37.792844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94432d9-4540-4d2b-aaea-199699325469 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:37.794836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 17/31] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:37 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:37.796153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94432d9-4540-4d2b-aaea-199699325469 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:37.902721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3aca6-d11b-4a30-a9b4-4584837f3da9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:37.920618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:37.997007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d5b16-1b11-4f82-9c61-d72c5baeba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:37.998014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d5b16-1b11-4f82-9c61-d72c5baeba98 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.003862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d5b16-1b11-4f82-9c61-d72c5baeba98 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.003862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d5b16-1b11-4f82-9c61-d72c5baeba98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.006274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94432d9-4540-4d2b-aaea-199699325469 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:38.021173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d5b16-1b11-4f82-9c61-d72c5baeba98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:38.024463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d5b16-1b11-4f82-9c61-d72c5baeba98 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4b8d5b16-1b11-4f82-9c61-d72c5baeba98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:12:38.055611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:38.056491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:38.057304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:12:38.057304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:12:38.057304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:12:38.057304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:38.057304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 15/32] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 514 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:38.057304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4267645-e751-43c3-a58d-57625e312369 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.057304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4267645-e751-43c3-a58d-57625e312369 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.057304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4267645-e751-43c3-a58d-57625e312369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.059336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:38.065355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a555ae3-34d3-49a7-a799-71eded4f51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:38.066742 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555ae3-34d3-49a7-a799-71eded4f51b0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.067378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555ae3-34d3-49a7-a799-71eded4f51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.068113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555ae3-34d3-49a7-a799-71eded4f51b0 None admin] PATH_INFO: `/v3/users/6a0908b00117426e8a0fae922d56155e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.070885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a555ae3-34d3-49a7-a799-71eded4f51b0 None admin] RBAC: Authorizing `identity:get_user(user_id=6a0908b00117426e8a0fae922d56155e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:38.072684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a555ae3-34d3-49a7-a799-71eded4f51b0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:38.074661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 18/33] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:37 2022] GET /identity/v3/users/6a0908b00117426e8a0fae922d56155e => generated 248 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:38.075725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a555ae3-34d3-49a7-a799-71eded4f51b0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:38.075840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b4267645-e751-43c3-a58d-57625e312369 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:38.083584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b4267645-e751-43c3-a58d-57625e312369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:38.154330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 16/34] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:38.160463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4267645-e751-43c3-a58d-57625e312369 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:38.208136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a555ae3-34d3-49a7-a799-71eded4f51b0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:38.252728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a7db2-741d-4c1a-9982-a78c14e12ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:38.253484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a7db2-741d-4c1a-9982-a78c14e12ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.253766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a7db2-741d-4c1a-9982-a78c14e12ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.254045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a7db2-741d-4c1a-9982-a78c14e12ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.254779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a7db2-741d-4c1a-9982-a78c14e12ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:38.255149 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a7db2-741d-4c1a-9982-a78c14e12ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:38.256633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a7db2-741d-4c1a-9982-a78c14e12ee6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:38.263438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:38.280356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 19/35] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:12:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:38.280525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4267645-e751-43c3-a58d-57625e312369 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:38.280625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172d13-29c9-4810-84f4-1891142c3027 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.280625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172d13-29c9-4810-84f4-1891142c3027 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.280625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172d13-29c9-4810-84f4-1891142c3027 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.280625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 20/36] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:38.280625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172d13-29c9-4810-84f4-1891142c3027 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:38.319373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebff702-8b75-4df5-b79b-7e9a4b4363d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:38.320217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebff702-8b75-4df5-b79b-7e9a4b4363d3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.320480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebff702-8b75-4df5-b79b-7e9a4b4363d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.320916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebff702-8b75-4df5-b79b-7e9a4b4363d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.323121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebff702-8b75-4df5-b79b-7e9a4b4363d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:38.324625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebff702-8b75-4df5-b79b-7e9a4b4363d3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:38.326676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 17/37] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:38.332524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebff702-8b75-4df5-b79b-7e9a4b4363d3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:38.347610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:38.399010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172d13-29c9-4810-84f4-1891142c3027 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:38.437434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd161d-2adc-4cda-a79c-70505296dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:38.438355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd161d-2adc-4cda-a79c-70505296dd04 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.438791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd161d-2adc-4cda-a79c-70505296dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.439072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd161d-2adc-4cda-a79c-70505296dd04 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.439904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd161d-2adc-4cda-a79c-70505296dd04 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:38.441243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd161d-2adc-4cda-a79c-70505296dd04 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:38.442753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebff702-8b75-4df5-b79b-7e9a4b4363d3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:38.467582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 21/38] 10.222.0.112 () {60 vars in 1136 bytes} [Fri Jun 3 16:12:38 2022] POST /identity/v3/roles => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:12:38.467582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a113d-2d4b-424f-8d4e-b2ee867fd839 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.467582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a113d-2d4b-424f-8d4e-b2ee867fd839 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.467582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a113d-2d4b-424f-8d4e-b2ee867fd839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.490151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-bf7a113d-2d4b-424f-8d4e-b2ee867fd839 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:38.492644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bf7a113d-2d4b-424f-8d4e-b2ee867fd839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:38.495893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fe386-8f04-4c41-b3b9-38e2a46018d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:38.496708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe386-8f04-4c41-b3b9-38e2a46018d2 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.497098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe386-8f04-4c41-b3b9-38e2a46018d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.497477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fe386-8f04-4c41-b3b9-38e2a46018d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.498399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fe386-8f04-4c41-b3b9-38e2a46018d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:38.500127 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fe386-8f04-4c41-b3b9-38e2a46018d2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:38.580155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 22/39] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:38.582168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a113d-2d4b-424f-8d4e-b2ee867fd839 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:38.639004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:38.668463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 18/40] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:12:38 2022] POST /identity/v3/projects => generated 302 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:12:38.669966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96003531-3a91-4f89-bea5-b1b31bf217c4 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.670266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96003531-3a91-4f89-bea5-b1b31bf217c4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.670557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96003531-3a91-4f89-bea5-b1b31bf217c4 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.671876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 19/41] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:38.676497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96003531-3a91-4f89-bea5-b1b31bf217c4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:38.690447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:38.725403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a113d-2d4b-424f-8d4e-b2ee867fd839 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:38.772545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c46de5-96a4-47a5-9201-a10407d8a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:38.773618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c46de5-96a4-47a5-9201-a10407d8a65f None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.773998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c46de5-96a4-47a5-9201-a10407d8a65f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.774377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c46de5-96a4-47a5-9201-a10407d8a65f None admin] PATH_INFO: `/v3/domains/default/users/6a0908b00117426e8a0fae922d56155e/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.776704 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c46de5-96a4-47a5-9201-a10407d8a65f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6a0908b00117426e8a0fae922d56155e, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:38.778320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c46de5-96a4-47a5-9201-a10407d8a65f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:38.795932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 23/42] 10.222.0.112 () {58 vars in 1366 bytes} [Fri Jun 3 16:12:38 2022] PUT /identity/v3/domains/default/users/6a0908b00117426e8a0fae922d56155e/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:12:38.797475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c978-18db-4896-87fd-aa244d82057c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.797862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c978-18db-4896-87fd-aa244d82057c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.798241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c978-18db-4896-87fd-aa244d82057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.816673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-73c5c978-18db-4896-87fd-aa244d82057c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:38.818100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-73c5c978-18db-4896-87fd-aa244d82057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:38.835083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96003531-3a91-4f89-bea5-b1b31bf217c4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:38.880914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103cda-0aa4-4562-a0a3-f38a6dcbf398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:38.881831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103cda-0aa4-4562-a0a3-f38a6dcbf398 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:38.882193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103cda-0aa4-4562-a0a3-f38a6dcbf398 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:38.882619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103cda-0aa4-4562-a0a3-f38a6dcbf398 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:38.884234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103cda-0aa4-4562-a0a3-f38a6dcbf398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:38.886168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103cda-0aa4-4562-a0a3-f38a6dcbf398 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:38.888471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 20/43] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:38.894689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103cda-0aa4-4562-a0a3-f38a6dcbf398 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:38.902130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 24/44] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:38.926616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c978-18db-4896-87fd-aa244d82057c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:38.976186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:38.999145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:39.030736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103cda-0aa4-4562-a0a3-f38a6dcbf398 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:39.061463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c978-18db-4896-87fd-aa244d82057c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:39.067744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a040a47-908a-410e-ac1c-ef9c71f23313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:39.068659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040a47-908a-410e-ac1c-ef9c71f23313 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:39.069159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040a47-908a-410e-ac1c-ef9c71f23313 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:39.069620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040a47-908a-410e-ac1c-ef9c71f23313 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:39.070919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a040a47-908a-410e-ac1c-ef9c71f23313 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:39.072968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a040a47-908a-410e-ac1c-ef9c71f23313 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:39.099148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed885e81-a8ac-4136-8ca1-06c25236b2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:39.099794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed885e81-a8ac-4136-8ca1-06c25236b2f3 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:39.100084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed885e81-a8ac-4136-8ca1-06c25236b2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:39.100435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed885e81-a8ac-4136-8ca1-06c25236b2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:39.101106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed885e81-a8ac-4136-8ca1-06c25236b2f3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:39.107586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 21/45] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:12:38 2022] POST /identity/v3/projects => generated 313 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:12:39.107791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed885e81-a8ac-4136-8ca1-06c25236b2f3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:39.124340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 25/46] 10.222.0.112 () {60 vars in 1136 bytes} [Fri Jun 3 16:12:38 2022] POST /identity/v3/roles => generated 224 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:12:41.072845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e000bb-476e-4f55-9d7f-41eb895ec015 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.073388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e000bb-476e-4f55-9d7f-41eb895ec015 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.073388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e000bb-476e-4f55-9d7f-41eb895ec015 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.074773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 22/47] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:41.080595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24ed2b-fd53-49ce-817a-4a0bd6463f8a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.080985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24ed2b-fd53-49ce-817a-4a0bd6463f8a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.081159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24ed2b-fd53-49ce-817a-4a0bd6463f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.098199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fd24ed2b-fd53-49ce-817a-4a0bd6463f8a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:41.099394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fd24ed2b-fd53-49ce-817a-4a0bd6463f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:41.165458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 26/48] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:41.188663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e000bb-476e-4f55-9d7f-41eb895ec015 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:41.292717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e000bb-476e-4f55-9d7f-41eb895ec015 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:41.319171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:41.328076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85518c-fd82-491e-b84f-f7daec5d2c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:41.328862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85518c-fd82-491e-b84f-f7daec5d2c59 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.329657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85518c-fd82-491e-b84f-f7daec5d2c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.329940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85518c-fd82-491e-b84f-f7daec5d2c59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.340792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85518c-fd82-491e-b84f-f7daec5d2c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-6d85518c-fd82-491e-b84f-f7daec5d2c59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:41.347840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:41.348724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:41.349657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 23/49] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:12:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:41.354792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24ed2b-fd53-49ce-817a-4a0bd6463f8a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:41.372299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0af74-4a29-422d-9635-f76ec265c2cd None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.372589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0af74-4a29-422d-9635-f76ec265c2cd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.372873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0af74-4a29-422d-9635-f76ec265c2cd None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.374243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 24/50] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:12:41.379593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31429210-ffca-4828-89d6-0b3861e4dbd9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.379871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31429210-ffca-4828-89d6-0b3861e4dbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.380146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31429210-ffca-4828-89d6-0b3861e4dbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.381356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:41.397887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-31429210-ffca-4828-89d6-0b3861e4dbd9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:41.399416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-31429210-ffca-4828-89d6-0b3861e4dbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:41.458606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24ed2b-fd53-49ce-817a-4a0bd6463f8a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:41.468199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 25/51] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:41.491455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31429210-ffca-4828-89d6-0b3861e4dbd9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:41.491755 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc36f7d-5fae-4c1d-ab86-e2f1ba5200b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:41.492404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36f7d-5fae-4c1d-ab86-e2f1ba5200b4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.492692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36f7d-5fae-4c1d-ab86-e2f1ba5200b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.493064 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc36f7d-5fae-4c1d-ab86-e2f1ba5200b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.493729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc36f7d-5fae-4c1d-ab86-e2f1ba5200b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:41.494039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc36f7d-5fae-4c1d-ab86-e2f1ba5200b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:41.495455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc36f7d-5fae-4c1d-ab86-e2f1ba5200b4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:41.505400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 27/52] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:41.511201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc36f7d-5fae-4c1d-ab86-e2f1ba5200b4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:41.594066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31429210-ffca-4828-89d6-0b3861e4dbd9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:41.596528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:41.612165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:41.613861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc36f7d-5fae-4c1d-ab86-e2f1ba5200b4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:41.631085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a44bdf-4d51-4a22-8db8-3b43104f2105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:41.631925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a44bdf-4d51-4a22-8db8-3b43104f2105 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.632208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a44bdf-4d51-4a22-8db8-3b43104f2105 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.632561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a44bdf-4d51-4a22-8db8-3b43104f2105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.633763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a44bdf-4d51-4a22-8db8-3b43104f2105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:41.635231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a44bdf-4d51-4a22-8db8-3b43104f2105 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:41.636899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 26/53] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:41.642485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a44bdf-4d51-4a22-8db8-3b43104f2105 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:41.647621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1a16-ab61-4a77-8f5d-d0b9afcd91f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:41.648491 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1a16-ab61-4a77-8f5d-d0b9afcd91f7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.648776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1a16-ab61-4a77-8f5d-d0b9afcd91f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.649055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1a16-ab61-4a77-8f5d-d0b9afcd91f7 None admin] PATH_INFO: `/v3/users/6a0908b00117426e8a0fae922d56155e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.650263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a1a16-ab61-4a77-8f5d-d0b9afcd91f7 None admin] RBAC: Authorizing `identity:get_user(user_id=6a0908b00117426e8a0fae922d56155e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:41.651743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a1a16-ab61-4a77-8f5d-d0b9afcd91f7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:41.653367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 28/54] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:41 2022] GET /identity/v3/users/6a0908b00117426e8a0fae922d56155e => generated 248 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:41.658863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1a16-ab61-4a77-8f5d-d0b9afcd91f7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:41.744608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a44bdf-4d51-4a22-8db8-3b43104f2105 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:41.759347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1a16-ab61-4a77-8f5d-d0b9afcd91f7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:41.779010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18728c3f-2533-4473-92f8-9da972751918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:41.779703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18728c3f-2533-4473-92f8-9da972751918 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.779994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18728c3f-2533-4473-92f8-9da972751918 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.780279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18728c3f-2533-4473-92f8-9da972751918 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.780996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18728c3f-2533-4473-92f8-9da972751918 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:41.782479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18728c3f-2533-4473-92f8-9da972751918 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:41.792436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc4fa8-6b2a-4d26-b1b1-9e0616a4c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:41.793225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc4fa8-6b2a-4d26-b1b1-9e0616a4c981 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.793514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc4fa8-6b2a-4d26-b1b1-9e0616a4c981 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.793812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc4fa8-6b2a-4d26-b1b1-9e0616a4c981 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.794983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc4fa8-6b2a-4d26-b1b1-9e0616a4c981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:41.796484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc4fa8-6b2a-4d26-b1b1-9e0616a4c981 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:41.798673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 29/55] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:41.804907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc4fa8-6b2a-4d26-b1b1-9e0616a4c981 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:41.815069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 27/56] 10.222.0.112 () {60 vars in 1145 bytes} [Fri Jun 3 16:12:41 2022] POST /identity/v3/projects => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:12:41.831579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:41.917005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc4fa8-6b2a-4d26-b1b1-9e0616a4c981 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:41.953173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f816bed-c265-4dfa-ace7-c52fbc5506ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:41.953851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f816bed-c265-4dfa-ace7-c52fbc5506ae None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:41.954141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f816bed-c265-4dfa-ace7-c52fbc5506ae None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:41.954427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f816bed-c265-4dfa-ace7-c52fbc5506ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:41.955287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f816bed-c265-4dfa-ace7-c52fbc5506ae None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.domain.id=default, user.id=6a0908b00117426e8a0fae922d56155e) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:41.955633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f816bed-c265-4dfa-ace7-c52fbc5506ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:41.957130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f816bed-c265-4dfa-ace7-c52fbc5506ae None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:41.963919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 30/57] 10.222.0.112 () {56 vars in 1327 bytes} [Fri Jun 3 16:12:41 2022] GET /identity/v3/role_assignments?user.id=6a0908b00117426e8a0fae922d56155e&scope.domain.id=default&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 532 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:44.083658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fa3a1-2230-424a-be01-e15f5fe85ffb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:44.084208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fa3a1-2230-424a-be01-e15f5fe85ffb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:44.084208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fa3a1-2230-424a-be01-e15f5fe85ffb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:44.085593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 28/58] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:44.090792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3cea-4401-4d14-b8d1-9af7ee11ab70 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:44.091188 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3cea-4401-4d14-b8d1-9af7ee11ab70 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:44.091366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3cea-4401-4d14-b8d1-9af7ee11ab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:44.108745 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-547a3cea-4401-4d14-b8d1-9af7ee11ab70 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:44.109951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-547a3cea-4401-4d14-b8d1-9af7ee11ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:44.174362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 31/59] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:44.198470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fa3a1-2230-424a-be01-e15f5fe85ffb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:44.239879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:44.301366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fa3a1-2230-424a-be01-e15f5fe85ffb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:44.335302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361692c-c105-40f7-8004-eaa9409996af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:44.336049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361692c-c105-40f7-8004-eaa9409996af None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:44.336339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361692c-c105-40f7-8004-eaa9409996af None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:44.336625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361692c-c105-40f7-8004-eaa9409996af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:44.337815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361692c-c105-40f7-8004-eaa9409996af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:44.339291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361692c-c105-40f7-8004-eaa9409996af None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:44.340932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 29/60] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:44.346466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a3cea-4401-4d14-b8d1-9af7ee11ab70 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:44.363785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:44.443596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a3cea-4401-4d14-b8d1-9af7ee11ab70 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:44.475886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb17993-6e79-44a2-8038-e213275988ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:44.476548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb17993-6e79-44a2-8038-e213275988ae None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:44.476833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb17993-6e79-44a2-8038-e213275988ae None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:44.477112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb17993-6e79-44a2-8038-e213275988ae None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:44.477825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb17993-6e79-44a2-8038-e213275988ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:44.479289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb17993-6e79-44a2-8038-e213275988ae None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:44.506236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 32/61] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:12:44 2022] POST /identity/v3/users => generated 276 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:12:48.497883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32fa5c-192b-4d93-8993-db8605c38a67 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.498878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32fa5c-192b-4d93-8993-db8605c38a67 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.499371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32fa5c-192b-4d93-8993-db8605c38a67 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.501049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 30/62] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:48.506987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb655158-2d43-4d8f-83fb-c84ee9405807 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.507587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03deba9-ed1d-48fc-8d25-c8dfbda6530a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.507956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb655158-2d43-4d8f-83fb-c84ee9405807 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.508244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb655158-2d43-4d8f-83fb-c84ee9405807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.508551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03deba9-ed1d-48fc-8d25-c8dfbda6530a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.509076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03deba9-ed1d-48fc-8d25-c8dfbda6530a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.510927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 31/63] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:48.518921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7db56-109e-4c1f-a8d2-330e1eaf9c56 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.519570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7db56-109e-4c1f-a8d2-330e1eaf9c56 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.520050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7db56-109e-4c1f-a8d2-330e1eaf9c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.544538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-cb655158-2d43-4d8f-83fb-c84ee9405807 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:48.546072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-cb655158-2d43-4d8f-83fb-c84ee9405807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:48.552889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-52e7db56-109e-4c1f-a8d2-330e1eaf9c56 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:48.555124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-52e7db56-109e-4c1f-a8d2-330e1eaf9c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:48.648997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 33/64] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:48.662509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892fc74-573b-40b6-a6f3-e9d71502a61c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.663080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892fc74-573b-40b6-a6f3-e9d71502a61c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.663583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892fc74-573b-40b6-a6f3-e9d71502a61c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.665127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 34/65] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:12:48.670221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73790490-6054-416b-92d8-6995c35268fc None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.670839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73790490-6054-416b-92d8-6995c35268fc None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.671309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73790490-6054-416b-92d8-6995c35268fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.683155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:48.689716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 32/66] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:48.690850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7db56-109e-4c1f-a8d2-330e1eaf9c56 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:48.691478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-73790490-6054-416b-92d8-6995c35268fc None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:48.693783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-73790490-6054-416b-92d8-6995c35268fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:48.732363 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:48.802273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 35/67] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:48.802892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73790490-6054-416b-92d8-6995c35268fc None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:48.815328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7db56-109e-4c1f-a8d2-330e1eaf9c56 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:48.852927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20fc0d-c74d-4921-93e4-17434e56af18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:48.853748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20fc0d-c74d-4921-93e4-17434e56af18 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.854047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20fc0d-c74d-4921-93e4-17434e56af18 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.854328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20fc0d-c74d-4921-93e4-17434e56af18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.865478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20fc0d-c74d-4921-93e4-17434e56af18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-0c20fc0d-c74d-4921-93e4-17434e56af18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:48.874011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:48.875067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:48.876600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 33/68] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:12:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:48.877253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b05b46-1a55-41e4-ba1a-3c7e1c22f7b6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.877320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b05b46-1a55-41e4-ba1a-3c7e1c22f7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.877696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b05b46-1a55-41e4-ba1a-3c7e1c22f7b6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.879015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 34/69] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:48.879711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b05b46-1a55-41e4-ba1a-3c7e1c22f7b6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:48.917851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73790490-6054-416b-92d8-6995c35268fc None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:48.947152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:48.952431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f21e69-91e7-4bd0-aafe-8c25d3e020fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:48.953227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f21e69-91e7-4bd0-aafe-8c25d3e020fe None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.953537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f21e69-91e7-4bd0-aafe-8c25d3e020fe None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.954347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f21e69-91e7-4bd0-aafe-8c25d3e020fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.965222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f21e69-91e7-4bd0-aafe-8c25d3e020fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d5f21e69-91e7-4bd0-aafe-8c25d3e020fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:48.972814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:48.973677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:12:48.974465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 36/70] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:48.975255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d2424-8ce5-4613-8da6-3aee9cbe02cf None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:48.975508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d2424-8ce5-4613-8da6-3aee9cbe02cf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:48.975810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d2424-8ce5-4613-8da6-3aee9cbe02cf None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:48.977103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 37/71] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:48.977880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d2424-8ce5-4613-8da6-3aee9cbe02cf None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:48.980351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:48.989371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b05b46-1a55-41e4-ba1a-3c7e1c22f7b6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.022968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0ed19-a03b-4e93-8877-6d94b1e9e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.023797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0ed19-a03b-4e93-8877-6d94b1e9e0be None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.024088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0ed19-a03b-4e93-8877-6d94b1e9e0be None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.024367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0ed19-a03b-4e93-8877-6d94b1e9e0be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.025552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0ed19-a03b-4e93-8877-6d94b1e9e0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:49.027015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0ed19-a03b-4e93-8877-6d94b1e9e0be None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:49.033316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 35/72] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:48 2022] GET /identity/v3/domains/default => generated 200 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:49.033316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492aa06-d8db-4fcf-8f2e-d4467bccc224 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.033316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492aa06-d8db-4fcf-8f2e-d4467bccc224 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.033316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492aa06-d8db-4fcf-8f2e-d4467bccc224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.046075 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6492aa06-d8db-4fcf-8f2e-d4467bccc224 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:49.047295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6492aa06-d8db-4fcf-8f2e-d4467bccc224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:49.081545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d2424-8ce5-4613-8da6-3aee9cbe02cf None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.114607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 36/73] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:49.115462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492aa06-d8db-4fcf-8f2e-d4467bccc224 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:49.115659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5fdfa-3ac1-49d1-9dab-9fea52e5fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.116371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5fdfa-3ac1-49d1-9dab-9fea52e5fb97 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.116664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5fdfa-3ac1-49d1-9dab-9fea52e5fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.116945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5fdfa-3ac1-49d1-9dab-9fea52e5fb97 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.117709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5fdfa-3ac1-49d1-9dab-9fea52e5fb97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:49.118019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5fdfa-3ac1-49d1-9dab-9fea52e5fb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:49.119432 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5fdfa-3ac1-49d1-9dab-9fea52e5fb97 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:49.132559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 38/74] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:12:48 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:49.132559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f85d2-a5bc-401f-a7c7-2e03e0100163 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.132559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f85d2-a5bc-401f-a7c7-2e03e0100163 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.132559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f85d2-a5bc-401f-a7c7-2e03e0100163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.147451 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fa3f85d2-a5bc-401f-a7c7-2e03e0100163 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:49.148692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fa3f85d2-a5bc-401f-a7c7-2e03e0100163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:49.200219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:49.216787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 39/75] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:49.217350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:49.217600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f85d2-a5bc-401f-a7c7-2e03e0100163 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:49.231062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492aa06-d8db-4fcf-8f2e-d4467bccc224 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.267307 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c228ac-0854-4fe4-9236-67ae6172f65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.268015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c228ac-0854-4fe4-9236-67ae6172f65c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.268304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c228ac-0854-4fe4-9236-67ae6172f65c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.268587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c228ac-0854-4fe4-9236-67ae6172f65c None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.269343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c228ac-0854-4fe4-9236-67ae6172f65c None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:49.269653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c228ac-0854-4fe4-9236-67ae6172f65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:49.271080 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c228ac-0854-4fe4-9236-67ae6172f65c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:49.283403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 37/76] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:12:49 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:49.284292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c228ac-0854-4fe4-9236-67ae6172f65c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:49.325269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f85d2-a5bc-401f-a7c7-2e03e0100163 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.361066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c83b2-e301-43c2-bb23-8f6762a954e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.361661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c83b2-e301-43c2-bb23-8f6762a954e0 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.361948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c83b2-e301-43c2-bb23-8f6762a954e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.362231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c83b2-e301-43c2-bb23-8f6762a954e0 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.362947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c83b2-e301-43c2-bb23-8f6762a954e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:49.364458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c83b2-e301-43c2-bb23-8f6762a954e0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:49.382765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c228ac-0854-4fe4-9236-67ae6172f65c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.383927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 40/77] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:12:49 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:12:49.384746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c83b2-e301-43c2-bb23-8f6762a954e0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:49.435968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:49.437459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429da9-3d36-49c4-9acb-ccb9c0c1d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.439086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429da9-3d36-49c4-9acb-ccb9c0c1d217 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.439539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429da9-3d36-49c4-9acb-ccb9c0c1d217 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.439846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429da9-3d36-49c4-9acb-ccb9c0c1d217 None admin] PATH_INFO: `/v3/users/a26d924814b24c6e9a1fa3e7eec884a3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.458613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8429da9-3d36-49c4-9acb-ccb9c0c1d217 None admin] RBAC: Authorizing `identity:get_user(user_id=a26d924814b24c6e9a1fa3e7eec884a3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:49.460262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8429da9-3d36-49c4-9acb-ccb9c0c1d217 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:49.462494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 38/78] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:49 2022] GET /identity/v3/users/a26d924814b24c6e9a1fa3e7eec884a3 => generated 276 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:49.463391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429da9-3d36-49c4-9acb-ccb9c0c1d217 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:49.486040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:49.510605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c83b2-e301-43c2-bb23-8f6762a954e0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.552342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395884d9-d86b-4113-85eb-acff8d06395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.554257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395884d9-d86b-4113-85eb-acff8d06395d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.554551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395884d9-d86b-4113-85eb-acff8d06395d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.554838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395884d9-d86b-4113-85eb-acff8d06395d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.567115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395884d9-d86b-4113-85eb-acff8d06395d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-395884d9-d86b-4113-85eb-acff8d06395d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:49.575390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:49.576347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:12:49.577245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 41/79] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:49.577886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395884d9-d86b-4113-85eb-acff8d06395d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:49.590938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429da9-3d36-49c4-9acb-ccb9c0c1d217 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.633146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932478-8600-4070-855e-3071a96aba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.633966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932478-8600-4070-855e-3071a96aba6b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.634248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932478-8600-4070-855e-3071a96aba6b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.634776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932478-8600-4070-855e-3071a96aba6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.645720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1932478-8600-4070-855e-3071a96aba6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e1932478-8600-4070-855e-3071a96aba6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:49.653362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:49.654245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:49.655190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 39/80] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:49.655990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932478-8600-4070-855e-3071a96aba6b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:49.709025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:49.714114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395884d9-d86b-4113-85eb-acff8d06395d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.760624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dabdb-e09a-4cb5-8ac6-d814c86b1612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.762317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dabdb-e09a-4cb5-8ac6-d814c86b1612 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.762785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dabdb-e09a-4cb5-8ac6-d814c86b1612 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.763654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dabdb-e09a-4cb5-8ac6-d814c86b1612 None admin] PATH_INFO: `/v3/users/a26d924814b24c6e9a1fa3e7eec884a3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.765464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dabdb-e09a-4cb5-8ac6-d814c86b1612 None admin] RBAC: Authorizing `identity:get_user(user_id=a26d924814b24c6e9a1fa3e7eec884a3)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:49.767423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980dabdb-e09a-4cb5-8ac6-d814c86b1612 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:49.769325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:49.770110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 42/81] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:49 2022] GET /identity/v3/users/a26d924814b24c6e9a1fa3e7eec884a3 => generated 276 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:49.770700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dabdb-e09a-4cb5-8ac6-d814c86b1612 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:49.795098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932478-8600-4070-855e-3071a96aba6b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.838504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1fdc6-ad4d-47da-9ea5-56c53950554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.839472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1fdc6-ad4d-47da-9ea5-56c53950554c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.839795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1fdc6-ad4d-47da-9ea5-56c53950554c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.840333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1fdc6-ad4d-47da-9ea5-56c53950554c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.879570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980dabdb-e09a-4cb5-8ac6-d814c86b1612 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:49.916500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e3bf-70d4-4468-bd10-acae822a5032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:49.917265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e3bf-70d4-4468-bd10-acae822a5032 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:49.917653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e3bf-70d4-4468-bd10-acae822a5032 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:49.918037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e3bf-70d4-4468-bd10-acae822a5032 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:49.918904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834e3bf-70d4-4468-bd10-acae822a5032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:49.919335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834e3bf-70d4-4468-bd10-acae822a5032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:49.920880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834e3bf-70d4-4468-bd10-acae822a5032 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:49.924879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1fdc6-ad4d-47da-9ea5-56c53950554c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:49.926382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1fdc6-ad4d-47da-9ea5-56c53950554c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:49.930571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 43/82] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:49.935805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e3bf-70d4-4468-bd10-acae822a5032 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:49.973932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:50.052985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e3bf-70d4-4468-bd10-acae822a5032 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:50.056086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:50.060348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 40/83] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:12:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:12:50.061698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1fdc6-ad4d-47da-9ea5-56c53950554c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:50.098060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5dc8-f642-44a7-9913-788eb9abfc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:50.099650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5dc8-f642-44a7-9913-788eb9abfc37 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:50.100237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5dc8-f642-44a7-9913-788eb9abfc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:50.100780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5dc8-f642-44a7-9913-788eb9abfc37 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:50.101687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5dc8-f642-44a7-9913-788eb9abfc37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:50.102210 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5dc8-f642-44a7-9913-788eb9abfc37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:50.104988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5dc8-f642-44a7-9913-788eb9abfc37 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:50.116898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 44/84] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:12:49 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:50.117709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5dc8-f642-44a7-9913-788eb9abfc37 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:50.182108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1fdc6-ad4d-47da-9ea5-56c53950554c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:50.213035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:50.224347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d5f5b-fcba-4f72-bacc-cd9dfef590ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:50.224815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5dc8-f642-44a7-9913-788eb9abfc37 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:50.225250 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d5f5b-fcba-4f72-bacc-cd9dfef590ab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:50.225635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d5f5b-fcba-4f72-bacc-cd9dfef590ab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:50.226013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d5f5b-fcba-4f72-bacc-cd9dfef590ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:50.262608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab90e0f-bb81-4023-ba0b-19e2dcacc114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:50.263720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab90e0f-bb81-4023-ba0b-19e2dcacc114 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:50.264108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab90e0f-bb81-4023-ba0b-19e2dcacc114 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:50.264549 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab90e0f-bb81-4023-ba0b-19e2dcacc114 None admin] PATH_INFO: `/v3/users/6a0908b00117426e8a0fae922d56155e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:50.265830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab90e0f-bb81-4023-ba0b-19e2dcacc114 None admin] RBAC: Authorizing `identity:get_user(user_id=6a0908b00117426e8a0fae922d56155e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:50.268095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab90e0f-bb81-4023-ba0b-19e2dcacc114 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:50.274431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 45/85] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:50 2022] GET /identity/v3/users/6a0908b00117426e8a0fae922d56155e => generated 248 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:50.274431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab90e0f-bb81-4023-ba0b-19e2dcacc114 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:50.284792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:50.315483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d5f5b-fcba-4f72-bacc-cd9dfef590ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:50.317494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d5f5b-fcba-4f72-bacc-cd9dfef590ab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:50.376077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab90e0f-bb81-4023-ba0b-19e2dcacc114 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:50.411532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa73df-00bb-43d0-a82b-8ef2a77f0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:50.412537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa73df-00bb-43d0-a82b-8ef2a77f0532 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:50.412887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa73df-00bb-43d0-a82b-8ef2a77f0532 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:50.413228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa73df-00bb-43d0-a82b-8ef2a77f0532 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:50.414516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa73df-00bb-43d0-a82b-8ef2a77f0532 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:50.416132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa73df-00bb-43d0-a82b-8ef2a77f0532 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:50.418112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 46/86] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:50 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:50.418849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa73df-00bb-43d0-a82b-8ef2a77f0532 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:50.433467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 41/87] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:12:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:12:50.434818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d5f5b-fcba-4f72-bacc-cd9dfef590ab None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:50.448844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:50.518282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:50.523386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa73df-00bb-43d0-a82b-8ef2a77f0532 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:50.548970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d5f5b-fcba-4f72-bacc-cd9dfef590ab None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:50.558566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c730f-af59-4b81-8652-10a9c5f3b784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:50.559545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c730f-af59-4b81-8652-10a9c5f3b784 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:50.559935 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c730f-af59-4b81-8652-10a9c5f3b784 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:50.560283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c730f-af59-4b81-8652-10a9c5f3b784 None admin] PATH_INFO: `/v3/users/a26d924814b24c6e9a1fa3e7eec884a3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:50.561573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c730f-af59-4b81-8652-10a9c5f3b784 None admin] RBAC: Authorizing `identity:get_user(user_id=a26d924814b24c6e9a1fa3e7eec884a3)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:50.563134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c730f-af59-4b81-8652-10a9c5f3b784 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:50.565194 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 47/88] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:50 2022] GET /identity/v3/users/a26d924814b24c6e9a1fa3e7eec884a3 => generated 276 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:50.566062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c730f-af59-4b81-8652-10a9c5f3b784 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:50.590084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bab2c-d0a3-4974-af5d-f32eccb65540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:50.590733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bab2c-d0a3-4974-af5d-f32eccb65540 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:50.591019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bab2c-d0a3-4974-af5d-f32eccb65540 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:50.591538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bab2c-d0a3-4974-af5d-f32eccb65540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:50.664899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:50.666907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bab2c-d0a3-4974-af5d-f32eccb65540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:50.669434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bab2c-d0a3-4974-af5d-f32eccb65540 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:50.673275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c730f-af59-4b81-8652-10a9c5f3b784 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:50.710006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886f2a-488f-41b1-85da-b50a0765ce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:50.710706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886f2a-488f-41b1-85da-b50a0765ce33 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:50.711082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886f2a-488f-41b1-85da-b50a0765ce33 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:50.711434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886f2a-488f-41b1-85da-b50a0765ce33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:50.712454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5886f2a-488f-41b1-85da-b50a0765ce33 None admin] RBAC: Adding query filter params (role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=4148325ec8614e9bbea65c25532b96a0, user.id=a26d924814b24c6e9a1fa3e7eec884a3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:50.712849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5886f2a-488f-41b1-85da-b50a0765ce33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:50.714546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5886f2a-488f-41b1-85da-b50a0765ce33 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:50.721810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 48/89] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:12:50 2022] GET /identity/v3/role_assignments?user.id=a26d924814b24c6e9a1fa3e7eec884a3&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:50.722787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886f2a-488f-41b1-85da-b50a0765ce33 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:50.757306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:50.790065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 42/90] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:12:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:12:50.791047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bab2c-d0a3-4974-af5d-f32eccb65540 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:50.835184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886f2a-488f-41b1-85da-b50a0765ce33 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:50.881490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75001754-89f4-433e-a227-5b651934e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:50.882440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001754-89f4-433e-a227-5b651934e576 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:50.882727 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001754-89f4-433e-a227-5b651934e576 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:50.883010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001754-89f4-433e-a227-5b651934e576 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:50.885628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75001754-89f4-433e-a227-5b651934e576 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:50.887172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75001754-89f4-433e-a227-5b651934e576 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:50.889261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 49/91] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:50 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:50.890106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75001754-89f4-433e-a227-5b651934e576 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:50.909681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bab2c-d0a3-4974-af5d-f32eccb65540 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:50.958525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:50.959334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8675b4-f6c1-4904-b251-3a3627bf34ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:50.960449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8675b4-f6c1-4904-b251-3a3627bf34ac None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:50.960683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8675b4-f6c1-4904-b251-3a3627bf34ac None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:50.960964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8675b4-f6c1-4904-b251-3a3627bf34ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:51.040367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:51.069522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75001754-89f4-433e-a227-5b651934e576 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:51.073382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8675b4-f6c1-4904-b251-3a3627bf34ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:51.074868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8675b4-f6c1-4904-b251-3a3627bf34ac None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:51.107657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b946582-0adc-456b-93bf-6b180df72025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:51.108631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b946582-0adc-456b-93bf-6b180df72025 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:51.108969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b946582-0adc-456b-93bf-6b180df72025 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:51.109312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b946582-0adc-456b-93bf-6b180df72025 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:51.110729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b946582-0adc-456b-93bf-6b180df72025 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:51.112240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b946582-0adc-456b-93bf-6b180df72025 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:51.114624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 50/92] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:50 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:51.115677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b946582-0adc-456b-93bf-6b180df72025 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:51.178381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 43/93] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:12:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:12:51.179271 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8675b4-f6c1-4904-b251-3a3627bf34ac None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:51.291663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:51.315028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:51.326582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b946582-0adc-456b-93bf-6b180df72025 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:51.346064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8675b4-f6c1-4904-b251-3a3627bf34ac None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:51.388718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8230c98-ed79-4cd2-86f3-cbfb5f6e2b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:51.389424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8230c98-ed79-4cd2-86f3-cbfb5f6e2b28 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:51.389708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8230c98-ed79-4cd2-86f3-cbfb5f6e2b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:51.389981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8230c98-ed79-4cd2-86f3-cbfb5f6e2b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:51.390818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8230c98-ed79-4cd2-86f3-cbfb5f6e2b28 None admin] RBAC: Adding query filter params (role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=4148325ec8614e9bbea65c25532b96a0, user.id=a26d924814b24c6e9a1fa3e7eec884a3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:51.391682 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8230c98-ed79-4cd2-86f3-cbfb5f6e2b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:51.393150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8230c98-ed79-4cd2-86f3-cbfb5f6e2b28 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:51.410410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 51/94] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:12:51 2022] GET /identity/v3/role_assignments?user.id=a26d924814b24c6e9a1fa3e7eec884a3&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 260 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:51.411282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8230c98-ed79-4cd2-86f3-cbfb5f6e2b28 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:51.420736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03ccc8-b843-4693-93bd-c2b06a117ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:51.421430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03ccc8-b843-4693-93bd-c2b06a117ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:51.421711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03ccc8-b843-4693-93bd-c2b06a117ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:51.421987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03ccc8-b843-4693-93bd-c2b06a117ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:51.422889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03ccc8-b843-4693-93bd-c2b06a117ec4 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=4148325ec8614e9bbea65c25532b96a0, user.id=6a0908b00117426e8a0fae922d56155e) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:51.423201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03ccc8-b843-4693-93bd-c2b06a117ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:51.428528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03ccc8-b843-4693-93bd-c2b06a117ec4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:51.441816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 44/95] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:12:51 2022] GET /identity/v3/role_assignments?user.id=6a0908b00117426e8a0fae922d56155e&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:51.586298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8230c98-ed79-4cd2-86f3-cbfb5f6e2b28 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:51.624683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce456c36-246f-49f4-b66d-b39b4ead77b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:51.626161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce456c36-246f-49f4-b66d-b39b4ead77b9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:51.626442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce456c36-246f-49f4-b66d-b39b4ead77b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:51.626720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce456c36-246f-49f4-b66d-b39b4ead77b9 None admin] PATH_INFO: `/v3/projects/5c5af0b6e3df49818f3f240acd233060` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:51.628176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce456c36-246f-49f4-b66d-b39b4ead77b9 None admin] RBAC: Authorizing `identity:get_project(project_id=5c5af0b6e3df49818f3f240acd233060)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:51.629707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce456c36-246f-49f4-b66d-b39b4ead77b9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:51.631786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 52/96] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:51 2022] GET /identity/v3/projects/5c5af0b6e3df49818f3f240acd233060 => generated 313 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:51.637800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03ccc8-b843-4693-93bd-c2b06a117ec4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:51.770114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03ccc8-b843-4693-93bd-c2b06a117ec4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:51.816399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada45caa-40b5-4b6c-95b7-37453345e8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:51.817165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada45caa-40b5-4b6c-95b7-37453345e8fa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:51.817819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada45caa-40b5-4b6c-95b7-37453345e8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:51.818106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada45caa-40b5-4b6c-95b7-37453345e8fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:51.818982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada45caa-40b5-4b6c-95b7-37453345e8fa None admin] RBAC: Adding query filter params (role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=5c5af0b6e3df49818f3f240acd233060, user.id=a26d924814b24c6e9a1fa3e7eec884a3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:51.819295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada45caa-40b5-4b6c-95b7-37453345e8fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:51.821121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada45caa-40b5-4b6c-95b7-37453345e8fa None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:51.828370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 45/97] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:12:51 2022] GET /identity/v3/role_assignments?user.id=a26d924814b24c6e9a1fa3e7eec884a3&scope.project.id=5c5af0b6e3df49818f3f240acd233060&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:52.115257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd2f4-bad3-4cc9-ae5a-5fd71e2a072f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:52.115666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd2f4-bad3-4cc9-ae5a-5fd71e2a072f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:52.115840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd2f4-bad3-4cc9-ae5a-5fd71e2a072f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:52.117365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 53/98] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:52.132965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a17431-f117-43a2-8159-392ebdd65f9c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:52.133285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a17431-f117-43a2-8159-392ebdd65f9c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:52.133513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a17431-f117-43a2-8159-392ebdd65f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:52.138728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:52.160687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f9a17431-f117-43a2-8159-392ebdd65f9c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:52.161914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f9a17431-f117-43a2-8159-392ebdd65f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:52.255596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 46/99] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:52.289599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd2f4-bad3-4cc9-ae5a-5fd71e2a072f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:52.320333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:52.413062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd2f4-bad3-4cc9-ae5a-5fd71e2a072f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:52.414816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65025ba-fd68-46a6-a268-525455d79872 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:52.415103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65025ba-fd68-46a6-a268-525455d79872 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:52.415377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65025ba-fd68-46a6-a268-525455d79872 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:52.416775 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 47/100] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:12:52.423543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321854e-e22f-4ab5-bf33-e1c7e05144b8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:52.424051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321854e-e22f-4ab5-bf33-e1c7e05144b8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:52.424477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321854e-e22f-4ab5-bf33-e1c7e05144b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:52.455660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9321854e-e22f-4ab5-bf33-e1c7e05144b8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:52.457122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9321854e-e22f-4ab5-bf33-e1c7e05144b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:52.467248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d93c45-66f2-42cc-9c87-323eb6f998de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:52.468522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d93c45-66f2-42cc-9c87-323eb6f998de None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:52.469069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d93c45-66f2-42cc-9c87-323eb6f998de None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:52.469554 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d93c45-66f2-42cc-9c87-323eb6f998de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:52.498308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d93c45-66f2-42cc-9c87-323eb6f998de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d9d93c45-66f2-42cc-9c87-323eb6f998de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:52.508480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:52.509421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:12:52.510229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:12:52.517891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 54/101] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:52.528876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d93c45-66f2-42cc-9c87-323eb6f998de None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:52.605818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 48/102] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:52.648761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321854e-e22f-4ab5-bf33-e1c7e05144b8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:52.676841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:52.697745 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d93c45-66f2-42cc-9c87-323eb6f998de None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:52.767606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:52.771758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43f4ce-637c-4102-b018-977b665b7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:52.772715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f4ce-637c-4102-b018-977b665b7e4b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:52.773243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f4ce-637c-4102-b018-977b665b7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:52.773729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f4ce-637c-4102-b018-977b665b7e4b None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:52.775526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43f4ce-637c-4102-b018-977b665b7e4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:52.776674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43f4ce-637c-4102-b018-977b665b7e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:52.778439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43f4ce-637c-4102-b018-977b665b7e4b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:52.800177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 55/103] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:12:52 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:52.807276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43f4ce-637c-4102-b018-977b665b7e4b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:52.837781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321854e-e22f-4ab5-bf33-e1c7e05144b8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:52.910023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860351ce-cad5-4758-8773-30e338940a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:52.911190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860351ce-cad5-4758-8773-30e338940a57 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:52.911734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860351ce-cad5-4758-8773-30e338940a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:52.912223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860351ce-cad5-4758-8773-30e338940a57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:52.914559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860351ce-cad5-4758-8773-30e338940a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:52.916272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860351ce-cad5-4758-8773-30e338940a57 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:52.918126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 49/104] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:52.924737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860351ce-cad5-4758-8773-30e338940a57 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:53.013484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43f4ce-637c-4102-b018-977b665b7e4b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:53.083310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7c72-13e3-4f67-9d6b-56ddd3bc6a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:53.084618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7c72-13e3-4f67-9d6b-56ddd3bc6a41 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:53.085138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7c72-13e3-4f67-9d6b-56ddd3bc6a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:53.086241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d7c72-13e3-4f67-9d6b-56ddd3bc6a41 None admin] PATH_INFO: `/v3/users/5a5540023a4c4d54a454ccd6da170569` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:53.116033 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d7c72-13e3-4f67-9d6b-56ddd3bc6a41 None admin] RBAC: Authorizing `identity:get_user(user_id=5a5540023a4c4d54a454ccd6da170569)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:53.118686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d7c72-13e3-4f67-9d6b-56ddd3bc6a41 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:53.122094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860351ce-cad5-4758-8773-30e338940a57 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:53.124089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 56/105] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:52 2022] GET /identity/v3/users/5a5540023a4c4d54a454ccd6da170569 => generated 290 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:53.129447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7c72-13e3-4f67-9d6b-56ddd3bc6a41 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:53.151281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:53.190116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:53.203095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f1110-bdd2-4300-9138-888c9a73b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:53.204611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f1110-bdd2-4300-9138-888c9a73b6e8 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:53.204900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f1110-bdd2-4300-9138-888c9a73b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:53.205184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f1110-bdd2-4300-9138-888c9a73b6e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:53.205913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f1110-bdd2-4300-9138-888c9a73b6e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:53.207388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f1110-bdd2-4300-9138-888c9a73b6e8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:53.267451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 50/106] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:12:52 2022] POST /identity/v3/projects => generated 303 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:12:53.329158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d7c72-13e3-4f67-9d6b-56ddd3bc6a41 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:53.382774 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e6b0a-7ad9-4bee-a008-f366a493f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:53.383447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e6b0a-7ad9-4bee-a008-f366a493f85a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:53.383756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e6b0a-7ad9-4bee-a008-f366a493f85a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:53.384038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e6b0a-7ad9-4bee-a008-f366a493f85a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:53.478009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e6b0a-7ad9-4bee-a008-f366a493f85a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:53.479488 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e6b0a-7ad9-4bee-a008-f366a493f85a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:53.490523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:53.588168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 57/107] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:12:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:12:53.594189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f1110-bdd2-4300-9138-888c9a73b6e8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:53.754140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f1110-bdd2-4300-9138-888c9a73b6e8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:53.793984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7e21-8f3b-41ae-ba3f-ae3e8388fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:53.795209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7e21-8f3b-41ae-ba3f-ae3e8388fb75 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:53.795726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7e21-8f3b-41ae-ba3f-ae3e8388fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:53.796206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7e21-8f3b-41ae-ba3f-ae3e8388fb75 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:53.798152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7e21-8f3b-41ae-ba3f-ae3e8388fb75 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:53.799853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7e21-8f3b-41ae-ba3f-ae3e8388fb75 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:53.801763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 51/108] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:53 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:53.807643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e6b0a-7ad9-4bee-a008-f366a493f85a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:53.916493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e6b0a-7ad9-4bee-a008-f366a493f85a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:53.927032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:53.962723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636ed92-2642-437f-a06d-3eded5f4c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:53.963396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636ed92-2642-437f-a06d-3eded5f4c270 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:53.963710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636ed92-2642-437f-a06d-3eded5f4c270 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:53.963994 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636ed92-2642-437f-a06d-3eded5f4c270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:53.964844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636ed92-2642-437f-a06d-3eded5f4c270 None admin] RBAC: Adding query filter params (role.id=a1bdbf0d655e48afb678e720ec7d1d7a, scope.project.id=4148325ec8614e9bbea65c25532b96a0, user.id=5a5540023a4c4d54a454ccd6da170569) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:53.965160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636ed92-2642-437f-a06d-3eded5f4c270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:53.966811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636ed92-2642-437f-a06d-3eded5f4c270 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:53.976023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 58/109] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:12:53 2022] GET /identity/v3/role_assignments?user.id=5a5540023a4c4d54a454ccd6da170569&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=a1bdbf0d655e48afb678e720ec7d1d7a => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:54.108019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713821aa-c008-4245-9b99-7e66db09176d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:54.108676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713821aa-c008-4245-9b99-7e66db09176d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:54.109171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713821aa-c008-4245-9b99-7e66db09176d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:54.111314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 52/110] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:54 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:54.122443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97470497-2978-45a3-a373-c796a1bf5923 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:54.122729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97470497-2978-45a3-a373-c796a1bf5923 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:54.123196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97470497-2978-45a3-a373-c796a1bf5923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:54.152832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-97470497-2978-45a3-a373-c796a1bf5923 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:54.154109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-97470497-2978-45a3-a373-c796a1bf5923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:54.257849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 59/111] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:54.293400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713821aa-c008-4245-9b99-7e66db09176d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:54.358123 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:54.417736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713821aa-c008-4245-9b99-7e66db09176d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:54.460320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef42c1-8ce3-47ab-bc24-b8e70d185953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:54.461053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef42c1-8ce3-47ab-bc24-b8e70d185953 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:54.461337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef42c1-8ce3-47ab-bc24-b8e70d185953 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:54.461613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef42c1-8ce3-47ab-bc24-b8e70d185953 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:54.480316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef42c1-8ce3-47ab-bc24-b8e70d185953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1bef42c1-8ce3-47ab-bc24-b8e70d185953 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:54.491453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:54.492370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:54.493164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 53/112] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:12:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:54.498637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97470497-2978-45a3-a373-c796a1bf5923 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:54.622685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97470497-2978-45a3-a373-c796a1bf5923 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:54.624330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:54.660589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e6f13-31ce-4bbd-9c02-54d7a27158af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:54.661265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e6f13-31ce-4bbd-9c02-54d7a27158af None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:54.661546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e6f13-31ce-4bbd-9c02-54d7a27158af None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:54.661822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e6f13-31ce-4bbd-9c02-54d7a27158af None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:54.662587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e6f13-31ce-4bbd-9c02-54d7a27158af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:54.662893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e6f13-31ce-4bbd-9c02-54d7a27158af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:54.664315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e6f13-31ce-4bbd-9c02-54d7a27158af None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:54.673515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 60/113] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:12:54 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:54.679467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef42c1-8ce3-47ab-bc24-b8e70d185953 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:54.797202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea2e39-e400-40a1-bb22-4874c6df1b8e None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:54.798006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea2e39-e400-40a1-bb22-4874c6df1b8e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:54.798180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea2e39-e400-40a1-bb22-4874c6df1b8e None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:54.799718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 61/114] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:54.805082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65214c12-a160-4611-9887-3006908f9094 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:54.805353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65214c12-a160-4611-9887-3006908f9094 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:54.805627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65214c12-a160-4611-9887-3006908f9094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:54.826315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-65214c12-a160-4611-9887-3006908f9094 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:54.828931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-65214c12-a160-4611-9887-3006908f9094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:54.833149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef42c1-8ce3-47ab-bc24-b8e70d185953 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:54.849422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:54.893481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7bf2-a47d-400e-b989-a25ff28d29d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:54.894365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7bf2-a47d-400e-b989-a25ff28d29d1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:54.894652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7bf2-a47d-400e-b989-a25ff28d29d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:54.894928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff7bf2-a47d-400e-b989-a25ff28d29d1 None admin] PATH_INFO: `/v3/users/a26d924814b24c6e9a1fa3e7eec884a3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:54.896974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7bf2-a47d-400e-b989-a25ff28d29d1 None admin] RBAC: Authorizing `identity:get_user(user_id=a26d924814b24c6e9a1fa3e7eec884a3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:54.900437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff7bf2-a47d-400e-b989-a25ff28d29d1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:54.903438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 54/115] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:54 2022] GET /identity/v3/users/a26d924814b24c6e9a1fa3e7eec884a3 => generated 276 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:54.914414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7bf2-a47d-400e-b989-a25ff28d29d1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:54.965270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 62/116] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:54.979825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b914427-139e-4ce6-a862-6396799b8dd1 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:54.980119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b914427-139e-4ce6-a862-6396799b8dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:54.980406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b914427-139e-4ce6-a862-6396799b8dd1 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:54.982395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 63/117] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:12:54.988269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa1e9e-7bdd-438f-a819-124b065a4804 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:54.988663 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa1e9e-7bdd-438f-a819-124b065a4804 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:54.988956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa1e9e-7bdd-438f-a819-124b065a4804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.024621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-44fa1e9e-7bdd-438f-a819-124b065a4804 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:55.025965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-44fa1e9e-7bdd-438f-a819-124b065a4804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:55.040008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff7bf2-a47d-400e-b989-a25ff28d29d1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:55.080474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bd493-28ad-482b-97a8-ad1be2b86727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:55.081880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bd493-28ad-482b-97a8-ad1be2b86727 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:55.082170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bd493-28ad-482b-97a8-ad1be2b86727 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:55.082446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bd493-28ad-482b-97a8-ad1be2b86727 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.083697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041bd493-28ad-482b-97a8-ad1be2b86727 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:55.085153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041bd493-28ad-482b-97a8-ad1be2b86727 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:55.086918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 55/118] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:54 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:55.087900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bd493-28ad-482b-97a8-ad1be2b86727 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:55.151205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:55.218611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bd493-28ad-482b-97a8-ad1be2b86727 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:55.233225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 64/119] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:55.234176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa1e9e-7bdd-438f-a819-124b065a4804 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:55.258093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6da6de-757d-420f-8933-6db360293928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:55.259127 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6da6de-757d-420f-8933-6db360293928 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:55.259617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6da6de-757d-420f-8933-6db360293928 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:55.260145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6da6de-757d-420f-8933-6db360293928 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.272416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6da6de-757d-420f-8933-6db360293928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ee6da6de-757d-420f-8933-6db360293928 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:55.281024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:55.282091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:12:55.283021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:55.284926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 56/120] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:55.285994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6da6de-757d-420f-8933-6db360293928 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:55.320673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:55.395880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6da6de-757d-420f-8933-6db360293928 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:55.404093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:55.433897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012a4e6-2ef9-4021-8685-9a86be308591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:55.434993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012a4e6-2ef9-4021-8685-9a86be308591 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:55.435424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012a4e6-2ef9-4021-8685-9a86be308591 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:55.435973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012a4e6-2ef9-4021-8685-9a86be308591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.447690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012a4e6-2ef9-4021-8685-9a86be308591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5012a4e6-2ef9-4021-8685-9a86be308591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:55.456230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:55.457268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:12:55.458088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:55.460094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 57/121] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:12:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:55.461183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012a4e6-2ef9-4021-8685-9a86be308591 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:55.538266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa1e9e-7bdd-438f-a819-124b065a4804 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:55.574540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb4a4c-0051-45eb-9e0c-a39f4db81120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:55.575449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4a4c-0051-45eb-9e0c-a39f4db81120 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:55.575895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4a4c-0051-45eb-9e0c-a39f4db81120 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:55.576165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb4a4c-0051-45eb-9e0c-a39f4db81120 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0/users/a26d924814b24c6e9a1fa3e7eec884a3/roles/45adf513980e4f8a9eab6f81b4fd8b77` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.579398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb4a4c-0051-45eb-9e0c-a39f4db81120 None admin] RBAC: Authorizing `identity:create_grant(project_id=4148325ec8614e9bbea65c25532b96a0, user_id=a26d924814b24c6e9a1fa3e7eec884a3, role_id=45adf513980e4f8a9eab6f81b4fd8b77)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:55.583149 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb4a4c-0051-45eb-9e0c-a39f4db81120 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:55.588317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012a4e6-2ef9-4021-8685-9a86be308591 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:55.599646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 65/122] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:12:55 2022] PUT /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0/users/a26d924814b24c6e9a1fa3e7eec884a3/roles/45adf513980e4f8a9eab6f81b4fd8b77 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:12:55.601316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb4a4c-0051-45eb-9e0c-a39f4db81120 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:55.641724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e2491-1892-4d21-8255-e09dd15b3b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:55.642563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e2491-1892-4d21-8255-e09dd15b3b20 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:55.642921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e2491-1892-4d21-8255-e09dd15b3b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:55.643276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e2491-1892-4d21-8255-e09dd15b3b20 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.644221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e2491-1892-4d21-8255-e09dd15b3b20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:55.644609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e2491-1892-4d21-8255-e09dd15b3b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:55.646233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e2491-1892-4d21-8255-e09dd15b3b20 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:55.658611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 58/123] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:12:55 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:55.660421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5f1d6-f812-4abb-92f0-2a974832c3f9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:55.660783 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5f1d6-f812-4abb-92f0-2a974832c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:55.661138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5f1d6-f812-4abb-92f0-2a974832c3f9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.662797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 59/124] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:55.668622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5f1d6-f812-4abb-92f0-2a974832c3f9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:55.708641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:55.716616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:55.738565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb4a4c-0051-45eb-9e0c-a39f4db81120 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:55.780556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b09513-a1eb-4a1d-a7e6-754db53e2a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:55.782159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b09513-a1eb-4a1d-a7e6-754db53e2a8a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:55.783191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b09513-a1eb-4a1d-a7e6-754db53e2a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:55.783721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b09513-a1eb-4a1d-a7e6-754db53e2a8a None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.784875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b09513-a1eb-4a1d-a7e6-754db53e2a8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:55.785414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b09513-a1eb-4a1d-a7e6-754db53e2a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:55.787198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b09513-a1eb-4a1d-a7e6-754db53e2a8a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:55.799343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 66/125] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:55.801183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1c278-554e-4708-af9d-5b06352b7d26 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:55.801712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1c278-554e-4708-af9d-5b06352b7d26 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:55.802369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1c278-554e-4708-af9d-5b06352b7d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.822342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5ec1c278-554e-4708-af9d-5b06352b7d26 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:55.824979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5ec1c278-554e-4708-af9d-5b06352b7d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:55.906072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 67/126] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:55.912497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1c278-554e-4708-af9d-5b06352b7d26 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:55.936739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5f1d6-f812-4abb-92f0-2a974832c3f9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:55.989247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3fbd-9ae4-4ac7-a8d6-4b42ee8377a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:55.991043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3fbd-9ae4-4ac7-a8d6-4b42ee8377a3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:55.991516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3fbd-9ae4-4ac7-a8d6-4b42ee8377a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:55.992145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b3fbd-9ae4-4ac7-a8d6-4b42ee8377a3 None admin] PATH_INFO: `/v3/users/a26d924814b24c6e9a1fa3e7eec884a3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:55.994248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b3fbd-9ae4-4ac7-a8d6-4b42ee8377a3 None admin] RBAC: Authorizing `identity:get_user(user_id=a26d924814b24c6e9a1fa3e7eec884a3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:55.996285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b3fbd-9ae4-4ac7-a8d6-4b42ee8377a3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:55.998484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 60/127] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:55 2022] GET /identity/v3/users/a26d924814b24c6e9a1fa3e7eec884a3 => generated 276 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:55.999664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3fbd-9ae4-4ac7-a8d6-4b42ee8377a3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:56.043939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:56.056197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1c278-554e-4708-af9d-5b06352b7d26 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:56.113498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1130234-fcb3-4e7b-86e7-965a9bf05b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:56.115861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1130234-fcb3-4e7b-86e7-965a9bf05b3f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:56.118910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1130234-fcb3-4e7b-86e7-965a9bf05b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:56.119398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1130234-fcb3-4e7b-86e7-965a9bf05b3f None admin] PATH_INFO: `/v3/users/6a0908b00117426e8a0fae922d56155e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:56.120871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1130234-fcb3-4e7b-86e7-965a9bf05b3f None admin] RBAC: Authorizing `identity:get_user(user_id=6a0908b00117426e8a0fae922d56155e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:56.122826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1130234-fcb3-4e7b-86e7-965a9bf05b3f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:56.125706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 68/128] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:55 2022] GET /identity/v3/users/6a0908b00117426e8a0fae922d56155e => generated 248 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:56.128293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1130234-fcb3-4e7b-86e7-965a9bf05b3f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:56.228700 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:56.244226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1130234-fcb3-4e7b-86e7-965a9bf05b3f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:56.245089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b3fbd-9ae4-4ac7-a8d6-4b42ee8377a3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:56.286738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3f75-03e3-4d2c-8953-1c259d9db19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:56.287634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3f75-03e3-4d2c-8953-1c259d9db19b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:56.287923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3f75-03e3-4d2c-8953-1c259d9db19b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:56.288202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c3f75-03e3-4d2c-8953-1c259d9db19b None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:56.290184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c3f75-03e3-4d2c-8953-1c259d9db19b None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:56.291682 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c3f75-03e3-4d2c-8953-1c259d9db19b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:56.293578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 69/129] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:56 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:56.298267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3f75-03e3-4d2c-8953-1c259d9db19b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:56.308231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f813d-d9d9-46ed-a2ac-9790af8bc0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:56.309042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f813d-d9d9-46ed-a2ac-9790af8bc0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:56.309327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f813d-d9d9-46ed-a2ac-9790af8bc0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:56.309604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f813d-d9d9-46ed-a2ac-9790af8bc0d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:56.331780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:56.332651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f813d-d9d9-46ed-a2ac-9790af8bc0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-235f813d-d9d9-46ed-a2ac-9790af8bc0d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:56.343376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:56.344593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:12:56.345553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:12:56.347564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 61/130] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:56.348371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f813d-d9d9-46ed-a2ac-9790af8bc0d0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:56.453445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c3f75-03e3-4d2c-8953-1c259d9db19b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:56.503686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08592177-dbc1-4206-81df-d7f188f95f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:56.504830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08592177-dbc1-4206-81df-d7f188f95f15 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:56.505258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08592177-dbc1-4206-81df-d7f188f95f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:56.505711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08592177-dbc1-4206-81df-d7f188f95f15 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:56.509924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08592177-dbc1-4206-81df-d7f188f95f15 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:56.511660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08592177-dbc1-4206-81df-d7f188f95f15 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:56.513655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 70/131] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:56 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:56.520627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08592177-dbc1-4206-81df-d7f188f95f15 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:56.540139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f813d-d9d9-46ed-a2ac-9790af8bc0d0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:56.577403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1a8d5-678a-4447-968f-9ff931a75231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:56.579148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1a8d5-678a-4447-968f-9ff931a75231 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:56.579597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1a8d5-678a-4447-968f-9ff931a75231 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:56.580030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1a8d5-678a-4447-968f-9ff931a75231 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0/users/a26d924814b24c6e9a1fa3e7eec884a3/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:56.582239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1a8d5-678a-4447-968f-9ff931a75231 None admin] RBAC: Authorizing `identity:create_grant(project_id=4148325ec8614e9bbea65c25532b96a0, user_id=a26d924814b24c6e9a1fa3e7eec884a3, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:56.584776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1a8d5-678a-4447-968f-9ff931a75231 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:56.602729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 62/132] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:12:56 2022] PUT /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0/users/a26d924814b24c6e9a1fa3e7eec884a3/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:12:56.603969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1a8d5-678a-4447-968f-9ff931a75231 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:56.631422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:56.732702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:56.778176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08592177-dbc1-4206-81df-d7f188f95f15 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:56.801419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1a8d5-678a-4447-968f-9ff931a75231 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:56.853582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb6aa1-23e4-43e1-9150-ca7dae72296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:56.854520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb6aa1-23e4-43e1-9150-ca7dae72296a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:56.855291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb6aa1-23e4-43e1-9150-ca7dae72296a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:56.855764 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb6aa1-23e4-43e1-9150-ca7dae72296a None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:56.856749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb6aa1-23e4-43e1-9150-ca7dae72296a None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:56.857553 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb6aa1-23e4-43e1-9150-ca7dae72296a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:56.859252 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb6aa1-23e4-43e1-9150-ca7dae72296a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:56.869294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 71/133] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:12:56 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:56.873140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926c08c-26e9-4fc9-8bd2-84198c12de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:56.874021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926c08c-26e9-4fc9-8bd2-84198c12de40 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:56.874308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926c08c-26e9-4fc9-8bd2-84198c12de40 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:56.874593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926c08c-26e9-4fc9-8bd2-84198c12de40 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0/users/6a0908b00117426e8a0fae922d56155e/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:56.877005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb6aa1-23e4-43e1-9150-ca7dae72296a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:56.879710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926c08c-26e9-4fc9-8bd2-84198c12de40 None admin] RBAC: Authorizing `identity:create_grant(project_id=4148325ec8614e9bbea65c25532b96a0, user_id=6a0908b00117426e8a0fae922d56155e, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:56.881218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926c08c-26e9-4fc9-8bd2-84198c12de40 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:56.901078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 63/134] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:12:56 2022] PUT /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0/users/6a0908b00117426e8a0fae922d56155e/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:12:56.986179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e17be-9b6b-42a5-ace6-d3bd3f253b60 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:56.986804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e17be-9b6b-42a5-ace6-d3bd3f253b60 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:56.986804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e17be-9b6b-42a5-ace6-d3bd3f253b60 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:56.988577 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 64/135] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:12:56.994392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32604c8f-5b47-4212-8757-e945efc6e13b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:56.994810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32604c8f-5b47-4212-8757-e945efc6e13b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:56.995261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32604c8f-5b47-4212-8757-e945efc6e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:56.996506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb6aa1-23e4-43e1-9150-ca7dae72296a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:57.028842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-32604c8f-5b47-4212-8757-e945efc6e13b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:57.030158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-32604c8f-5b47-4212-8757-e945efc6e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:57.038539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175f9c0-23a8-4a25-9e39-bba450a55c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:57.039965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175f9c0-23a8-4a25-9e39-bba450a55c6b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:57.041747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175f9c0-23a8-4a25-9e39-bba450a55c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:57.042278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175f9c0-23a8-4a25-9e39-bba450a55c6b None admin] PATH_INFO: `/v3/users/a26d924814b24c6e9a1fa3e7eec884a3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:57.044770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175f9c0-23a8-4a25-9e39-bba450a55c6b None admin] RBAC: Authorizing `identity:get_user(user_id=a26d924814b24c6e9a1fa3e7eec884a3)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:57.049325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175f9c0-23a8-4a25-9e39-bba450a55c6b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:57.053362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 72/136] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:56 2022] GET /identity/v3/users/a26d924814b24c6e9a1fa3e7eec884a3 => generated 276 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:57.062979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175f9c0-23a8-4a25-9e39-bba450a55c6b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:57.086975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:57.166543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 65/137] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:57.175013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502d48-e72a-4150-8071-50898be77d4a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:57.175013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502d48-e72a-4150-8071-50898be77d4a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:57.175013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502d48-e72a-4150-8071-50898be77d4a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:57.175343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 66/138] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:57 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:57.180805 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfd524-b827-44a3-ac24-ab7e36647fcc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:57.181102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfd524-b827-44a3-ac24-ab7e36647fcc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:57.181387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfd524-b827-44a3-ac24-ab7e36647fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:57.198991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:57.212847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-35bfd524-b827-44a3-ac24-ab7e36647fcc None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:57.214353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-35bfd524-b827-44a3-ac24-ab7e36647fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:57.222069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175f9c0-23a8-4a25-9e39-bba450a55c6b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:57.274641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252d7e9-88da-4ff9-ab0d-d002cdb60f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:57.276127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252d7e9-88da-4ff9-ab0d-d002cdb60f1a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:57.276427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252d7e9-88da-4ff9-ab0d-d002cdb60f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:57.276868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252d7e9-88da-4ff9-ab0d-d002cdb60f1a None admin] PATH_INFO: `/v3/projects/5c5af0b6e3df49818f3f240acd233060` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:57.278422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252d7e9-88da-4ff9-ab0d-d002cdb60f1a None admin] RBAC: Authorizing `identity:get_project(project_id=5c5af0b6e3df49818f3f240acd233060)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:57.280651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252d7e9-88da-4ff9-ab0d-d002cdb60f1a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:57.283302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 73/139] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:57 2022] GET /identity/v3/projects/5c5af0b6e3df49818f3f240acd233060 => generated 313 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:57.284039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252d7e9-88da-4ff9-ab0d-d002cdb60f1a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:57.318469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 67/140] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:12:57.319655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfd524-b827-44a3-ac24-ab7e36647fcc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:57.373023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:57.396060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252d7e9-88da-4ff9-ab0d-d002cdb60f1a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:57.432011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58481c1-4d8a-47b5-bb5e-fe700c6fb065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:57.432813 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58481c1-4d8a-47b5-bb5e-fe700c6fb065 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:57.433097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58481c1-4d8a-47b5-bb5e-fe700c6fb065 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:57.433372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58481c1-4d8a-47b5-bb5e-fe700c6fb065 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:57.440647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfd524-b827-44a3-ac24-ab7e36647fcc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:57.445235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58481c1-4d8a-47b5-bb5e-fe700c6fb065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b58481c1-4d8a-47b5-bb5e-fe700c6fb065 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:57.453834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:57.454738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:12:57.455497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 74/141] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:12:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:57.457094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58481c1-4d8a-47b5-bb5e-fe700c6fb065 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:57.495383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ad20b-6ec8-4380-8641-18127377fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:57.496737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ad20b-6ec8-4380-8641-18127377fc78 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:57.497023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ad20b-6ec8-4380-8641-18127377fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:57.498821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ad20b-6ec8-4380-8641-18127377fc78 None admin] PATH_INFO: `/v3/projects/5c5af0b6e3df49818f3f240acd233060/users/a26d924814b24c6e9a1fa3e7eec884a3/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:57.504554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ad20b-6ec8-4380-8641-18127377fc78 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c5af0b6e3df49818f3f240acd233060, user_id=a26d924814b24c6e9a1fa3e7eec884a3, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:57.506821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ad20b-6ec8-4380-8641-18127377fc78 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:57.517531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:57.537997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 68/142] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:12:57 2022] PUT /identity/v3/projects/5c5af0b6e3df49818f3f240acd233060/users/a26d924814b24c6e9a1fa3e7eec884a3/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:12:57.538790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ad20b-6ec8-4380-8641-18127377fc78 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:57.655157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58481c1-4d8a-47b5-bb5e-fe700c6fb065 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:57.723884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b5521-25e4-41e7-9c06-9b5e96ae2bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:57.724689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5521-25e4-41e7-9c06-9b5e96ae2bdf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:57.724976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5521-25e4-41e7-9c06-9b5e96ae2bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:57.725250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5521-25e4-41e7-9c06-9b5e96ae2bdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:57.727228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b5521-25e4-41e7-9c06-9b5e96ae2bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:57.728751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b5521-25e4-41e7-9c06-9b5e96ae2bdf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:57.730467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 75/143] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:12:57 2022] GET /identity/v3/domains/default => generated 200 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:57.737916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b5521-25e4-41e7-9c06-9b5e96ae2bdf None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:57.752207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ad20b-6ec8-4380-8641-18127377fc78 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:57.764160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:57.839420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4bf3c-cf0b-492c-9fca-79ffd6f243af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:57.840116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4bf3c-cf0b-492c-9fca-79ffd6f243af None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:57.840400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4bf3c-cf0b-492c-9fca-79ffd6f243af None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:57.840676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4bf3c-cf0b-492c-9fca-79ffd6f243af None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:57.841450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4bf3c-cf0b-492c-9fca-79ffd6f243af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:57.841758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4bf3c-cf0b-492c-9fca-79ffd6f243af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:57.843207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4bf3c-cf0b-492c-9fca-79ffd6f243af None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:57.860456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 69/144] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:12:57 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:57.867180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4bf3c-cf0b-492c-9fca-79ffd6f243af None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:57.975994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:57.982351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b5521-25e4-41e7-9c06-9b5e96ae2bdf None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:58.048982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4bf3c-cf0b-492c-9fca-79ffd6f243af None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:58.053645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87518298-202a-495e-8425-e66d3f6f3d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:58.054327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87518298-202a-495e-8425-e66d3f6f3d39 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:58.054612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87518298-202a-495e-8425-e66d3f6f3d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:58.054887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87518298-202a-495e-8425-e66d3f6f3d39 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:58.055637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87518298-202a-495e-8425-e66d3f6f3d39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:58.057110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87518298-202a-495e-8425-e66d3f6f3d39 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:58.094407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 76/145] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:12:57 2022] POST /identity/v3/users => generated 284 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:12:58.106699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69671764-ba5c-456e-a61a-38a57e0f3366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:58.107985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69671764-ba5c-456e-a61a-38a57e0f3366 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:58.108280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69671764-ba5c-456e-a61a-38a57e0f3366 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:58.108566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69671764-ba5c-456e-a61a-38a57e0f3366 None admin] PATH_INFO: `/v3/users/5a5540023a4c4d54a454ccd6da170569` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:58.110437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69671764-ba5c-456e-a61a-38a57e0f3366 None admin] RBAC: Authorizing `identity:get_user(user_id=5a5540023a4c4d54a454ccd6da170569)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:58.112063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69671764-ba5c-456e-a61a-38a57e0f3366 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:58.114296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 70/146] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:57 2022] GET /identity/v3/users/5a5540023a4c4d54a454ccd6da170569 => generated 290 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:12:58.120261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87518298-202a-495e-8425-e66d3f6f3d39 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:58.209859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:58.261534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87518298-202a-495e-8425-e66d3f6f3d39 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:58.302885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f42e60-582a-498c-b66a-a35534d1851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:58.303880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42e60-582a-498c-b66a-a35534d1851d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:58.304219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42e60-582a-498c-b66a-a35534d1851d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:58.304504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42e60-582a-498c-b66a-a35534d1851d None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:58.305818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f42e60-582a-498c-b66a-a35534d1851d None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:58.307347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f42e60-582a-498c-b66a-a35534d1851d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:58.309388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 77/147] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:12:58 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:58.315156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69671764-ba5c-456e-a61a-38a57e0f3366 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:58.449128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69671764-ba5c-456e-a61a-38a57e0f3366 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:58.479074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:58.489880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59cd07-97cc-4063-8311-00ca52c7a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:58.490792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59cd07-97cc-4063-8311-00ca52c7a2ad None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:58.491340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59cd07-97cc-4063-8311-00ca52c7a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:58.492058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59cd07-97cc-4063-8311-00ca52c7a2ad None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0/users/5a5540023a4c4d54a454ccd6da170569/roles/a1bdbf0d655e48afb678e720ec7d1d7a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:58.494090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59cd07-97cc-4063-8311-00ca52c7a2ad None admin] RBAC: Authorizing `identity:create_grant(project_id=4148325ec8614e9bbea65c25532b96a0, user_id=5a5540023a4c4d54a454ccd6da170569, role_id=a1bdbf0d655e48afb678e720ec7d1d7a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:58.495597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59cd07-97cc-4063-8311-00ca52c7a2ad None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:58.518683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 71/148] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:12:58 2022] PUT /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0/users/5a5540023a4c4d54a454ccd6da170569/roles/a1bdbf0d655e48afb678e720ec7d1d7a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:12:58.912388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7cd3-7853-438b-a2f7-d388db1cae55 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:58.912678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7cd3-7853-438b-a2f7-d388db1cae55 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:58.913206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec7cd3-7853-438b-a2f7-d388db1cae55 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:58.915147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 78/149] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:12:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:12:58.920518 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8149f-6ad5-4539-8ce5-6895ab927e21 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:58.921120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8149f-6ad5-4539-8ce5-6895ab927e21 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:58.921603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8149f-6ad5-4539-8ce5-6895ab927e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:58.944591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3fd8149f-6ad5-4539-8ce5-6895ab927e21 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:12:58.946126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3fd8149f-6ad5-4539-8ce5-6895ab927e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:12:59.039337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 72/150] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:12:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:12:59.080118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec7cd3-7853-438b-a2f7-d388db1cae55 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:59.206832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec7cd3-7853-438b-a2f7-d388db1cae55 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:59.253475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:59.260401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfd90b-e988-455b-8d71-f03274688cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:59.261225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfd90b-e988-455b-8d71-f03274688cad None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:59.261508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfd90b-e988-455b-8d71-f03274688cad None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:59.261780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfd90b-e988-455b-8d71-f03274688cad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:59.278119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfd90b-e988-455b-8d71-f03274688cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-88cfd90b-e988-455b-8d71-f03274688cad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:12:59.287011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:12:59.287957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:12:59.288716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 79/151] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:12:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:12:59.294256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8149f-6ad5-4539-8ce5-6895ab927e21 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:59.415526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8149f-6ad5-4539-8ce5-6895ab927e21 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:59.433851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:59.455224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb633f4-3f0c-42ff-8ba3-7de88debef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:59.455939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb633f4-3f0c-42ff-8ba3-7de88debef5f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:59.456229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb633f4-3f0c-42ff-8ba3-7de88debef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:59.456511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb633f4-3f0c-42ff-8ba3-7de88debef5f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:59.457278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb633f4-3f0c-42ff-8ba3-7de88debef5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:12:59.457590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb633f4-3f0c-42ff-8ba3-7de88debef5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:59.459007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb633f4-3f0c-42ff-8ba3-7de88debef5f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:59.470289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 73/152] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:12:59 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:59.475579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfd90b-e988-455b-8d71-f03274688cad None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:59.634245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfd90b-e988-455b-8d71-f03274688cad None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:59.685502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79030fa8-207a-4915-a9fa-9d81d05cc15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:59.686299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79030fa8-207a-4915-a9fa-9d81d05cc15d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:59.686576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79030fa8-207a-4915-a9fa-9d81d05cc15d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:59.686849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79030fa8-207a-4915-a9fa-9d81d05cc15d None admin] PATH_INFO: `/v3/users/a26d924814b24c6e9a1fa3e7eec884a3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:59.692319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79030fa8-207a-4915-a9fa-9d81d05cc15d None admin] RBAC: Authorizing `identity:get_user(user_id=a26d924814b24c6e9a1fa3e7eec884a3)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:59.693830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79030fa8-207a-4915-a9fa-9d81d05cc15d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:12:59.695536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 80/153] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:12:59 2022] GET /identity/v3/users/a26d924814b24c6e9a1fa3e7eec884a3 => generated 276 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:12:59.701260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb633f4-3f0c-42ff-8ba3-7de88debef5f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:12:59.859944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb633f4-3f0c-42ff-8ba3-7de88debef5f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:12:59.907940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612a44f-fd3b-4d96-8311-17f4f8593012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:12:59.908673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a44f-fd3b-4d96-8311-17f4f8593012 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:12:59.908968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a44f-fd3b-4d96-8311-17f4f8593012 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:12:59.909272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612a44f-fd3b-4d96-8311-17f4f8593012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:12:59.969595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:12:59.988145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612a44f-fd3b-4d96-8311-17f4f8593012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:12:59.989747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612a44f-fd3b-4d96-8311-17f4f8593012 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:00.105580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 74/154] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:12:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:00.116676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79030fa8-207a-4915-a9fa-9d81d05cc15d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:00.191726 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:00.205496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375b0f7-cb15-4e6c-99d1-7af894014b0a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:00.205798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375b0f7-cb15-4e6c-99d1-7af894014b0a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:00.206166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375b0f7-cb15-4e6c-99d1-7af894014b0a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:00.212102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 75/155] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:00 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:00.213392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ceb7-5246-422c-b8ef-a2a3ff270d65 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:00.213686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ceb7-5246-422c-b8ef-a2a3ff270d65 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:00.213970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ceb7-5246-422c-b8ef-a2a3ff270d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:00.243096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-be41ceb7-5246-422c-b8ef-a2a3ff270d65 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:00.244332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-be41ceb7-5246-422c-b8ef-a2a3ff270d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:00.262431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79030fa8-207a-4915-a9fa-9d81d05cc15d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:00.345481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 76/156] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:00.358810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdf9bd-5bea-4adc-b2e0-d67b2b1bccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:00.360410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf9bd-5bea-4adc-b2e0-d67b2b1bccbc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:00.360776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf9bd-5bea-4adc-b2e0-d67b2b1bccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:00.361152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf9bd-5bea-4adc-b2e0-d67b2b1bccbc None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:00.366937 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdf9bd-5bea-4adc-b2e0-d67b2b1bccbc None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:00.368456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdf9bd-5bea-4adc-b2e0-d67b2b1bccbc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:00.370407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 81/157] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:00 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:00.376440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ceb7-5246-422c-b8ef-a2a3ff270d65 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:00.376725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdf9bd-5bea-4adc-b2e0-d67b2b1bccbc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:00.391148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:00.532772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ceb7-5246-422c-b8ef-a2a3ff270d65 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:00.580849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a365e-0574-4850-b6bc-eee6ac6bbdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:00.581925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a365e-0574-4850-b6bc-eee6ac6bbdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:00.582353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a365e-0574-4850-b6bc-eee6ac6bbdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:00.582769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a365e-0574-4850-b6bc-eee6ac6bbdd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:00.594494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a365e-0574-4850-b6bc-eee6ac6bbdd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b99a365e-0574-4850-b6bc-eee6ac6bbdd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:00.602749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:00.603994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:00.604807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:00.607420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 77/158] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:00.608909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327bb2f-2d66-459c-b012-1492eaa8b348 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:00.609943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327bb2f-2d66-459c-b012-1492eaa8b348 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:00.610397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327bb2f-2d66-459c-b012-1492eaa8b348 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:00.611881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 78/159] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:00.616647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327bb2f-2d66-459c-b012-1492eaa8b348 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:00.639159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdf9bd-5bea-4adc-b2e0-d67b2b1bccbc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:00.691532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:00.692318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:00.716307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049cefd-ebf2-496f-9366-19aca8de4d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:00.717036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049cefd-ebf2-496f-9366-19aca8de4d12 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:00.717256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049cefd-ebf2-496f-9366-19aca8de4d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:00.717534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049cefd-ebf2-496f-9366-19aca8de4d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:00.718379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049cefd-ebf2-496f-9366-19aca8de4d12 None admin] RBAC: Adding query filter params (role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=4148325ec8614e9bbea65c25532b96a0, user.id=a26d924814b24c6e9a1fa3e7eec884a3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:00.718730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049cefd-ebf2-496f-9366-19aca8de4d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:00.720281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049cefd-ebf2-496f-9366-19aca8de4d12 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:00.729853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327bb2f-2d66-459c-b012-1492eaa8b348 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:00.730771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 82/160] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:00 2022] GET /identity/v3/role_assignments?user.id=a26d924814b24c6e9a1fa3e7eec884a3&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 610 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:00.732419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e240985-a461-4452-a30b-a895ae235402 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:00.732712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e240985-a461-4452-a30b-a895ae235402 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:00.732990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e240985-a461-4452-a30b-a895ae235402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:00.768602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7e240985-a461-4452-a30b-a895ae235402 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:00.769830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7e240985-a461-4452-a30b-a895ae235402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:00.772052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b0772-fc02-47cb-91ac-d07a60c1f994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:00.772977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b0772-fc02-47cb-91ac-d07a60c1f994 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:00.773485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b0772-fc02-47cb-91ac-d07a60c1f994 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:00.773985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b0772-fc02-47cb-91ac-d07a60c1f994 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:00.774913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b0772-fc02-47cb-91ac-d07a60c1f994 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:00.775442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b0772-fc02-47cb-91ac-d07a60c1f994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:00.777133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b0772-fc02-47cb-91ac-d07a60c1f994 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:00.789353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 79/161] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:00 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:00.796812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b0772-fc02-47cb-91ac-d07a60c1f994 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:00.930162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 83/162] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:00.977683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e240985-a461-4452-a30b-a895ae235402 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:01.007996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b0772-fc02-47cb-91ac-d07a60c1f994 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:01.108106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:01.119504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48e379-4151-4ba5-b110-6e6d4c24115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:01.120626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48e379-4151-4ba5-b110-6e6d4c24115c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:01.120908 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48e379-4151-4ba5-b110-6e6d4c24115c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:01.121183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48e379-4151-4ba5-b110-6e6d4c24115c None admin] PATH_INFO: `/v3/users/a26d924814b24c6e9a1fa3e7eec884a3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:01.124145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48e379-4151-4ba5-b110-6e6d4c24115c None admin] RBAC: Authorizing `identity:get_user(user_id=a26d924814b24c6e9a1fa3e7eec884a3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:01.126414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48e379-4151-4ba5-b110-6e6d4c24115c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:01.129587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 80/163] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:00 2022] GET /identity/v3/users/a26d924814b24c6e9a1fa3e7eec884a3 => generated 276 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:01.136066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48e379-4151-4ba5-b110-6e6d4c24115c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:01.221360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e240985-a461-4452-a30b-a895ae235402 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:01.244515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:01.272237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fda19-30b8-4b15-a97c-aa8beec357cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:01.273055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fda19-30b8-4b15-a97c-aa8beec357cb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:01.273334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fda19-30b8-4b15-a97c-aa8beec357cb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:01.273605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fda19-30b8-4b15-a97c-aa8beec357cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:01.297364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fda19-30b8-4b15-a97c-aa8beec357cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-9f8fda19-30b8-4b15-a97c-aa8beec357cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:01.309217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:01.310358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:01.311346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 84/164] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:13:01.318971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fda19-30b8-4b15-a97c-aa8beec357cb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:01.401745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48e379-4151-4ba5-b110-6e6d4c24115c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:01.451740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fda19-30b8-4b15-a97c-aa8beec357cb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:01.492367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb2d49-f20f-4b57-b8c5-01c05f770c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:01.493054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb2d49-f20f-4b57-b8c5-01c05f770c45 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:01.493332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb2d49-f20f-4b57-b8c5-01c05f770c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:01.493606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb2d49-f20f-4b57-b8c5-01c05f770c45 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:01.494365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb2d49-f20f-4b57-b8c5-01c05f770c45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:01.494669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb2d49-f20f-4b57-b8c5-01c05f770c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:01.496122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb2d49-f20f-4b57-b8c5-01c05f770c45 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:01.498207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe18c64-8319-4926-aa79-9676f42a6866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:01.498967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18c64-8319-4926-aa79-9676f42a6866 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:01.499247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18c64-8319-4926-aa79-9676f42a6866 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:01.499518 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18c64-8319-4926-aa79-9676f42a6866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:01.518361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 85/165] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:01.526005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb2d49-f20f-4b57-b8c5-01c05f770c45 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:01.617207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:01.642025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:01.647861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe18c64-8319-4926-aa79-9676f42a6866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:01.649488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe18c64-8319-4926-aa79-9676f42a6866 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:01.761667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb2d49-f20f-4b57-b8c5-01c05f770c45 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:01.823678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 81/166] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:01.825043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d87cb9-090a-4dfe-851f-e99f8da8dd66 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:01.825334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d87cb9-090a-4dfe-851f-e99f8da8dd66 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:01.825612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d87cb9-090a-4dfe-851f-e99f8da8dd66 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:01.829840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 82/167] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:01 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:01.830578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d87cb9-090a-4dfe-851f-e99f8da8dd66 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:01.843391 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843d22f-056f-4c03-a2eb-34254324c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:01.844335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843d22f-056f-4c03-a2eb-34254324c689 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:01.844616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843d22f-056f-4c03-a2eb-34254324c689 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:01.844892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843d22f-056f-4c03-a2eb-34254324c689 None admin] PATH_INFO: `/v3/users/6a0908b00117426e8a0fae922d56155e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:01.847031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843d22f-056f-4c03-a2eb-34254324c689 None admin] RBAC: Authorizing `identity:get_user(user_id=6a0908b00117426e8a0fae922d56155e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:01.852928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843d22f-056f-4c03-a2eb-34254324c689 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:01.862047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 86/168] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:01 2022] GET /identity/v3/users/6a0908b00117426e8a0fae922d56155e => generated 248 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:01.863420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976733-50f7-4e0f-964a-53ad5c9af41a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:01.863732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976733-50f7-4e0f-964a-53ad5c9af41a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:01.864012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976733-50f7-4e0f-964a-53ad5c9af41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:01.901248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-cc976733-50f7-4e0f-964a-53ad5c9af41a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:01.902488 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-cc976733-50f7-4e0f-964a-53ad5c9af41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:02.031620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 87/169] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:02.036604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc976733-50f7-4e0f-964a-53ad5c9af41a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:02.077653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:02.087090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d87cb9-090a-4dfe-851f-e99f8da8dd66 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:02.119456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:02.145443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0debb-1681-462f-b77a-304cf70d8442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:02.146317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0debb-1681-462f-b77a-304cf70d8442 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:02.146750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0debb-1681-462f-b77a-304cf70d8442 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:02.147032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0debb-1681-462f-b77a-304cf70d8442 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:02.152390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0debb-1681-462f-b77a-304cf70d8442 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:02.154716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0debb-1681-462f-b77a-304cf70d8442 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:02.159759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 83/170] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:01 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:02.159759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0debb-1681-462f-b77a-304cf70d8442 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:02.255516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc976733-50f7-4e0f-964a-53ad5c9af41a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:02.315449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ed62-b789-49d4-8e69-af3a8591ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:02.316053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ed62-b789-49d4-8e69-af3a8591ea8a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:02.316335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ed62-b789-49d4-8e69-af3a8591ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:02.316610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ed62-b789-49d4-8e69-af3a8591ea8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:02.371546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0debb-1681-462f-b77a-304cf70d8442 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:02.440382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689a9f0-d2d2-44e8-8db3-02e74f4c2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:02.441185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a9f0-d2d2-44e8-8db3-02e74f4c2023 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:02.441466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a9f0-d2d2-44e8-8db3-02e74f4c2023 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:02.441738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689a9f0-d2d2-44e8-8db3-02e74f4c2023 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:02.454600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1ed62-b789-49d4-8e69-af3a8591ea8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:02.456191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1ed62-b789-49d4-8e69-af3a8591ea8a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:02.470819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689a9f0-d2d2-44e8-8db3-02e74f4c2023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3689a9f0-d2d2-44e8-8db3-02e74f4c2023 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:02.482597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:02.483591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:02.485041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 84/171] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:02.487649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689a9f0-d2d2-44e8-8db3-02e74f4c2023 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:02.536614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:02.547481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:02.644064 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 88/172] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:02 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:02.644936 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ed62-b789-49d4-8e69-af3a8591ea8a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:02.659646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689a9f0-d2d2-44e8-8db3-02e74f4c2023 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:02.699767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be45f3-bc63-43bf-bc03-43485abd24a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:02.700427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be45f3-bc63-43bf-bc03-43485abd24a3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:02.700711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be45f3-bc63-43bf-bc03-43485abd24a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:02.700985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be45f3-bc63-43bf-bc03-43485abd24a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:02.701824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be45f3-bc63-43bf-bc03-43485abd24a3 None admin] RBAC: Adding query filter params (role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=4148325ec8614e9bbea65c25532b96a0, user.id=a26d924814b24c6e9a1fa3e7eec884a3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:02.702136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be45f3-bc63-43bf-bc03-43485abd24a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:02.704172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be45f3-bc63-43bf-bc03-43485abd24a3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:02.711862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 85/173] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:02 2022] GET /identity/v3/role_assignments?user.id=a26d924814b24c6e9a1fa3e7eec884a3&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 610 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:02.712688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be45f3-bc63-43bf-bc03-43485abd24a3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:02.857493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:02.870271 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be45f3-bc63-43bf-bc03-43485abd24a3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:02.879138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ed62-b789-49d4-8e69-af3a8591ea8a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:02.914947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1755cce-05de-4907-b50b-6edf0b1c288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:02.916285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1755cce-05de-4907-b50b-6edf0b1c288a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:02.916914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1755cce-05de-4907-b50b-6edf0b1c288a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:02.920389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1755cce-05de-4907-b50b-6edf0b1c288a None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:02.922222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1755cce-05de-4907-b50b-6edf0b1c288a None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:02.923957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1755cce-05de-4907-b50b-6edf0b1c288a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:02.926183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 86/174] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:02 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:02.929063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadd553-6b49-43e8-91a8-b4165bdf0b13 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:02.931171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadd553-6b49-43e8-91a8-b4165bdf0b13 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:02.932507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadd553-6b49-43e8-91a8-b4165bdf0b13 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:02.936606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 87/175] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:02 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:02.938566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadd553-6b49-43e8-91a8-b4165bdf0b13 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:02.962370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf4cd3-c3bf-48e0-abb0-6f7612b9cd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:02.963445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf4cd3-c3bf-48e0-abb0-6f7612b9cd82 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:02.963955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf4cd3-c3bf-48e0-abb0-6f7612b9cd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:02.964446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf4cd3-c3bf-48e0-abb0-6f7612b9cd82 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:02.965425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf4cd3-c3bf-48e0-abb0-6f7612b9cd82 None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:02.965941 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf4cd3-c3bf-48e0-abb0-6f7612b9cd82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:02.967660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf4cd3-c3bf-48e0-abb0-6f7612b9cd82 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:02.990269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 89/176] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:02 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:02.992921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eecfb4-5c32-4b3e-8466-d06e7d8ab577 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:02.997019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eecfb4-5c32-4b3e-8466-d06e7d8ab577 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:02.997551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eecfb4-5c32-4b3e-8466-d06e7d8ab577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.009808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:03.026269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e3eecfb4-5c32-4b3e-8466-d06e7d8ab577 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:03.028556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e3eecfb4-5c32-4b3e-8466-d06e7d8ab577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:03.144952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 90/177] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:03.146179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eecfb4-5c32-4b3e-8466-d06e7d8ab577 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:03.151582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadd553-6b49-43e8-91a8-b4165bdf0b13 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:03.216785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715947-924d-4e93-b84c-7b7b02d6c708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:03.217804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715947-924d-4e93-b84c-7b7b02d6c708 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.218284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715947-924d-4e93-b84c-7b7b02d6c708 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.218813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715947-924d-4e93-b84c-7b7b02d6c708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.220450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715947-924d-4e93-b84c-7b7b02d6c708 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=4148325ec8614e9bbea65c25532b96a0, user.id=6a0908b00117426e8a0fae922d56155e) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:03.221726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715947-924d-4e93-b84c-7b7b02d6c708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:03.223837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715947-924d-4e93-b84c-7b7b02d6c708 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:03.232918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 88/178] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:02 2022] GET /identity/v3/role_assignments?user.id=6a0908b00117426e8a0fae922d56155e&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 610 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:03.235086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089a66-dc76-44e9-b9a3-abb9b8fa0ae2 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.235481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089a66-dc76-44e9-b9a3-abb9b8fa0ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.235775 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089a66-dc76-44e9-b9a3-abb9b8fa0ae2 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.239630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 89/179] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:03.241160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089a66-dc76-44e9-b9a3-abb9b8fa0ae2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:03.282891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:03.346899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eecfb4-5c32-4b3e-8466-d06e7d8ab577 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:03.427013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:03.428782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089a66-dc76-44e9-b9a3-abb9b8fa0ae2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:03.440718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f88bc1-d05f-434d-95e9-86552db00c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:03.441949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f88bc1-d05f-434d-95e9-86552db00c28 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.442404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f88bc1-d05f-434d-95e9-86552db00c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.442818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f88bc1-d05f-434d-95e9-86552db00c28 None admin] PATH_INFO: `/v3/users/a26d924814b24c6e9a1fa3e7eec884a3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.446108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f88bc1-d05f-434d-95e9-86552db00c28 None admin] RBAC: Authorizing `identity:get_user(user_id=a26d924814b24c6e9a1fa3e7eec884a3)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:03.447988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f88bc1-d05f-434d-95e9-86552db00c28 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:03.449931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 91/180] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:03 2022] GET /identity/v3/users/a26d924814b24c6e9a1fa3e7eec884a3 => generated 276 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:03.452640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13f3c8-aec5-456d-926c-83a682edc25e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.455075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13f3c8-aec5-456d-926c-83a682edc25e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.455515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13f3c8-aec5-456d-926c-83a682edc25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.490790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-bb13f3c8-aec5-456d-926c-83a682edc25e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:03.492039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bb13f3c8-aec5-456d-926c-83a682edc25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:03.503781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777ee5f-9489-4f36-a9dd-15d520234241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:03.505681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777ee5f-9489-4f36-a9dd-15d520234241 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.506128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777ee5f-9489-4f36-a9dd-15d520234241 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.506592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777ee5f-9489-4f36-a9dd-15d520234241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.522823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777ee5f-9489-4f36-a9dd-15d520234241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7777ee5f-9489-4f36-a9dd-15d520234241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:03.530862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:03.531885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:03.532676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 90/181] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:03.533321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777ee5f-9489-4f36-a9dd-15d520234241 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:03.606449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 92/182] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:03.608075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13f3c8-aec5-456d-926c-83a682edc25e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:03.654853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:03.676478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777ee5f-9489-4f36-a9dd-15d520234241 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:03.709505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b4fe0-a006-4d2e-b39b-19675a1e5b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:03.710055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b4fe0-a006-4d2e-b39b-19675a1e5b72 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.710342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b4fe0-a006-4d2e-b39b-19675a1e5b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.710615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b4fe0-a006-4d2e-b39b-19675a1e5b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.712570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13f3c8-aec5-456d-926c-83a682edc25e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:03.740484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:03.746586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b65cd-5639-4ad5-93e1-a8fb0fee0c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:03.747249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b65cd-5639-4ad5-93e1-a8fb0fee0c9d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.747529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b65cd-5639-4ad5-93e1-a8fb0fee0c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.747830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b65cd-5639-4ad5-93e1-a8fb0fee0c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.748579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b65cd-5639-4ad5-93e1-a8fb0fee0c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:03.748884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b65cd-5639-4ad5-93e1-a8fb0fee0c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:03.750863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b65cd-5639-4ad5-93e1-a8fb0fee0c9d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:03.759024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 93/183] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:03 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:03.760463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d39c-2389-4b1f-8ab8-bcfec217938c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.760753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d39c-2389-4b1f-8ab8-bcfec217938c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.761027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d39c-2389-4b1f-8ab8-bcfec217938c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.762410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 94/184] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:03.763030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10d39c-2389-4b1f-8ab8-bcfec217938c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:03.784156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b4fe0-a006-4d2e-b39b-19675a1e5b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:03.785658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b4fe0-a006-4d2e-b39b-19675a1e5b72 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:03.864440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10d39c-2389-4b1f-8ab8-bcfec217938c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:03.865189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:03.884137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 91/185] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:03.885455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25786d01-4da3-4826-98c2-29f4ca79ca84 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.885738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25786d01-4da3-4826-98c2-29f4ca79ca84 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.886011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25786d01-4da3-4826-98c2-29f4ca79ca84 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.887276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 92/186] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:03.887991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25786d01-4da3-4826-98c2-29f4ca79ca84 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:03.907449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114554f5-ccdb-4131-ae67-3390130e8080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:03.908271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114554f5-ccdb-4131-ae67-3390130e8080 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.908551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114554f5-ccdb-4131-ae67-3390130e8080 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.908822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114554f5-ccdb-4131-ae67-3390130e8080 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.918953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114554f5-ccdb-4131-ae67-3390130e8080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-114554f5-ccdb-4131-ae67-3390130e8080 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:03.927094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:03.928183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:03.929116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 95/187] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:03.929769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28f1d0-4a1f-44b3-80da-008e55c5aa9c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:03.929843 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28f1d0-4a1f-44b3-80da-008e55c5aa9c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:03.930065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28f1d0-4a1f-44b3-80da-008e55c5aa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:03.947203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5d28f1d0-4a1f-44b3-80da-008e55c5aa9c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:03.948415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5d28f1d0-4a1f-44b3-80da-008e55c5aa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:03.994027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25786d01-4da3-4826-98c2-29f4ca79ca84 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:03.994525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:04.014405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 96/188] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:04.015309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28f1d0-4a1f-44b3-80da-008e55c5aa9c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.041719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55408e9b-7420-4d41-9014-d0bc39ba945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.042590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55408e9b-7420-4d41-9014-d0bc39ba945d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.042874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55408e9b-7420-4d41-9014-d0bc39ba945d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.043152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55408e9b-7420-4d41-9014-d0bc39ba945d None admin] PATH_INFO: `/v3/users/5b51d2a00c9440e582bfcd1aae0d1701` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.057457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55408e9b-7420-4d41-9014-d0bc39ba945d None admin] RBAC: Authorizing `identity:get_user(user_id=5b51d2a00c9440e582bfcd1aae0d1701)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.058934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55408e9b-7420-4d41-9014-d0bc39ba945d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.060654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 93/189] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:03 2022] GET /identity/v3/users/5b51d2a00c9440e582bfcd1aae0d1701 => generated 284 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:04.062016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323331b2-3ffa-493e-a4a3-15448239d46e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.062341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323331b2-3ffa-493e-a4a3-15448239d46e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.062614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323331b2-3ffa-493e-a4a3-15448239d46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.081670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-323331b2-3ffa-493e-a4a3-15448239d46e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:04.082868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-323331b2-3ffa-493e-a4a3-15448239d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:04.118741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:04.122406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28f1d0-4a1f-44b3-80da-008e55c5aa9c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.153770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 94/190] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:04.154543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323331b2-3ffa-493e-a4a3-15448239d46e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.158039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346324b-f7cc-4a87-8190-6b63ec93972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.158910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346324b-f7cc-4a87-8190-6b63ec93972e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.159195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346324b-f7cc-4a87-8190-6b63ec93972e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.159471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346324b-f7cc-4a87-8190-6b63ec93972e None admin] PATH_INFO: `/v3/projects/5c5af0b6e3df49818f3f240acd233060` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.160830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346324b-f7cc-4a87-8190-6b63ec93972e None admin] RBAC: Authorizing `identity:get_project(project_id=5c5af0b6e3df49818f3f240acd233060)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.162308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346324b-f7cc-4a87-8190-6b63ec93972e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.164059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 97/191] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/projects/5c5af0b6e3df49818f3f240acd233060 => generated 313 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:04.164899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346324b-f7cc-4a87-8190-6b63ec93972e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.223133 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:04.256872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323331b2-3ffa-493e-a4a3-15448239d46e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.274706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346324b-f7cc-4a87-8190-6b63ec93972e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.291298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37ff5-f61a-4723-ab45-73b2644b8d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.291987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37ff5-f61a-4723-ab45-73b2644b8d0f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.292264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37ff5-f61a-4723-ab45-73b2644b8d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.292537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37ff5-f61a-4723-ab45-73b2644b8d0f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.293279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37ff5-f61a-4723-ab45-73b2644b8d0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:04.293589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37ff5-f61a-4723-ab45-73b2644b8d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.294960 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37ff5-f61a-4723-ab45-73b2644b8d0f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.303350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 95/192] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:04.304236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37ff5-f61a-4723-ab45-73b2644b8d0f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.313512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044c86-931b-45e1-8fe2-d8f9095d0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.314318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044c86-931b-45e1-8fe2-d8f9095d0475 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.314595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044c86-931b-45e1-8fe2-d8f9095d0475 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.314865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044c86-931b-45e1-8fe2-d8f9095d0475 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.324980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac044c86-931b-45e1-8fe2-d8f9095d0475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-ac044c86-931b-45e1-8fe2-d8f9095d0475 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:04.333781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:04.334767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:04.335926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 98/193] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:04.338122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:04.339341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044c86-931b-45e1-8fe2-d8f9095d0475 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.404503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37ff5-f61a-4723-ab45-73b2644b8d0f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.437464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a6611-9bd3-4b78-b358-81d509fe1c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.438110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a6611-9bd3-4b78-b358-81d509fe1c26 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.438395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a6611-9bd3-4b78-b358-81d509fe1c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.438574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044c86-931b-45e1-8fe2-d8f9095d0475 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.439007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a6611-9bd3-4b78-b358-81d509fe1c26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.448859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:04.473580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280411be-9127-472c-b0f1-c22881393233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.474228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280411be-9127-472c-b0f1-c22881393233 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.474515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280411be-9127-472c-b0f1-c22881393233 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.474793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280411be-9127-472c-b0f1-c22881393233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.475652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280411be-9127-472c-b0f1-c22881393233 None admin] RBAC: Adding query filter params (role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=5c5af0b6e3df49818f3f240acd233060, user.id=a26d924814b24c6e9a1fa3e7eec884a3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:04.475969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280411be-9127-472c-b0f1-c22881393233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.477441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280411be-9127-472c-b0f1-c22881393233 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.483527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 99/194] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/role_assignments?user.id=a26d924814b24c6e9a1fa3e7eec884a3&scope.project.id=5c5af0b6e3df49818f3f240acd233060&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 610 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:04.484341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280411be-9127-472c-b0f1-c22881393233 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.508592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a6611-9bd3-4b78-b358-81d509fe1c26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.509715 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a6611-9bd3-4b78-b358-81d509fe1c26 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.543812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:04.601699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280411be-9127-472c-b0f1-c22881393233 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.620120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 96/195] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:04.620977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a6611-9bd3-4b78-b358-81d509fe1c26 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.642540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35579077-ae30-4fe0-ab9d-842c4481cc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.643677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35579077-ae30-4fe0-ab9d-842c4481cc9e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.644108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35579077-ae30-4fe0-ab9d-842c4481cc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.644533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35579077-ae30-4fe0-ab9d-842c4481cc9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.645919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35579077-ae30-4fe0-ab9d-842c4481cc9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.647582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35579077-ae30-4fe0-ab9d-842c4481cc9e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.649515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 100/196] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:04.650620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35579077-ae30-4fe0-ab9d-842c4481cc9e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.700617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:04.741714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a6611-9bd3-4b78-b358-81d509fe1c26 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.770045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35579077-ae30-4fe0-ab9d-842c4481cc9e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.773137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:04.778248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60b129-53c0-4258-8b78-10f69272ddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.779122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60b129-53c0-4258-8b78-10f69272ddef None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.779403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60b129-53c0-4258-8b78-10f69272ddef None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.779728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60b129-53c0-4258-8b78-10f69272ddef None admin] PATH_INFO: `/v3/users/5a5540023a4c4d54a454ccd6da170569` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.780942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60b129-53c0-4258-8b78-10f69272ddef None admin] RBAC: Authorizing `identity:get_user(user_id=5a5540023a4c4d54a454ccd6da170569)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.782431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60b129-53c0-4258-8b78-10f69272ddef None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.784099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 97/197] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/users/5a5540023a4c4d54a454ccd6da170569 => generated 290 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:04.784862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60b129-53c0-4258-8b78-10f69272ddef None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.808239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3747e6-7ff7-4ca4-b5cd-6f3fc489c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.808896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3747e6-7ff7-4ca4-b5cd-6f3fc489c275 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.809173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3747e6-7ff7-4ca4-b5cd-6f3fc489c275 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.809442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3747e6-7ff7-4ca4-b5cd-6f3fc489c275 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.810181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3747e6-7ff7-4ca4-b5cd-6f3fc489c275 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:04.810483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3747e6-7ff7-4ca4-b5cd-6f3fc489c275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.811909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3747e6-7ff7-4ca4-b5cd-6f3fc489c275 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.820911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 101/198] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:04.821796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3747e6-7ff7-4ca4-b5cd-6f3fc489c275 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.887307 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60b129-53c0-4258-8b78-10f69272ddef None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.922731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b31c1-9977-4fa8-81bb-b1adb7b749b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.923317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3747e6-7ff7-4ca4-b5cd-6f3fc489c275 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:04.923657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b31c1-9977-4fa8-81bb-b1adb7b749b9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.923972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b31c1-9977-4fa8-81bb-b1adb7b749b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.924247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b31c1-9977-4fa8-81bb-b1adb7b749b9 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.925634 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b31c1-9977-4fa8-81bb-b1adb7b749b9 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.927358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b31c1-9977-4fa8-81bb-b1adb7b749b9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.927490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:04.934093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 98/199] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:04.934093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b31c1-9977-4fa8-81bb-b1adb7b749b9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:04.962709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241448c-aeb2-42b7-9e88-1af384fb7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:04.963382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241448c-aeb2-42b7-9e88-1af384fb7790 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:04.963709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241448c-aeb2-42b7-9e88-1af384fb7790 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:04.963989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241448c-aeb2-42b7-9e88-1af384fb7790 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:04.964703 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241448c-aeb2-42b7-9e88-1af384fb7790 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:04.966248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241448c-aeb2-42b7-9e88-1af384fb7790 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:04.986417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 102/200] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:13:04 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:13:04.987247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241448c-aeb2-42b7-9e88-1af384fb7790 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:05.007250 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:05.048568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b31c1-9977-4fa8-81bb-b1adb7b749b9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:05.089070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42275b0b-a80f-4fcd-a356-7f2440e17498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:05.090002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275b0b-a80f-4fcd-a356-7f2440e17498 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:05.090354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275b0b-a80f-4fcd-a356-7f2440e17498 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:05.090562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275b0b-a80f-4fcd-a356-7f2440e17498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:05.110562 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241448c-aeb2-42b7-9e88-1af384fb7790 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:05.148995 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37782f3-a50d-4924-89a8-f5fc73721dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:05.149886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37782f3-a50d-4924-89a8-f5fc73721dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:05.150231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37782f3-a50d-4924-89a8-f5fc73721dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:05.150519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37782f3-a50d-4924-89a8-f5fc73721dc8 None admin] PATH_INFO: `/v3/users/5b51d2a00c9440e582bfcd1aae0d1701` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:05.152070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37782f3-a50d-4924-89a8-f5fc73721dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=5b51d2a00c9440e582bfcd1aae0d1701)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:05.153371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37782f3-a50d-4924-89a8-f5fc73721dc8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:05.162729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 103/201] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/users/5b51d2a00c9440e582bfcd1aae0d1701 => generated 284 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:05.162729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37782f3-a50d-4924-89a8-f5fc73721dc8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:05.177018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42275b0b-a80f-4fcd-a356-7f2440e17498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:05.178479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42275b0b-a80f-4fcd-a356-7f2440e17498 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:05.199321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:05.262421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:05.301523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37782f3-a50d-4924-89a8-f5fc73721dc8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:05.306834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 99/202] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:05.308280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42275b0b-a80f-4fcd-a356-7f2440e17498 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:05.347659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275148-fd93-46d8-97f0-eb3e52256127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:05.348408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275148-fd93-46d8-97f0-eb3e52256127 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:05.348759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275148-fd93-46d8-97f0-eb3e52256127 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:05.349105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275148-fd93-46d8-97f0-eb3e52256127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:05.350023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34275148-fd93-46d8-97f0-eb3e52256127 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca, user.id=5b51d2a00c9440e582bfcd1aae0d1701) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:05.350403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34275148-fd93-46d8-97f0-eb3e52256127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:05.351977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34275148-fd93-46d8-97f0-eb3e52256127 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:05.358508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 104/203] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:05 2022] GET /identity/v3/role_assignments?user.id=5b51d2a00c9440e582bfcd1aae0d1701&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:05.360200 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275148-fd93-46d8-97f0-eb3e52256127 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:05.442527 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42275b0b-a80f-4fcd-a356-7f2440e17498 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:05.480120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bdb3f-52aa-4184-81a2-198c76729acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:05.480713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bdb3f-52aa-4184-81a2-198c76729acf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:05.481000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bdb3f-52aa-4184-81a2-198c76729acf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:05.481278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bdb3f-52aa-4184-81a2-198c76729acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:05.483994 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:05.494713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275148-fd93-46d8-97f0-eb3e52256127 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:05.520143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:05.538144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3ef5-5f15-492b-9ebc-005a262f3cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:05.539416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3ef5-5f15-492b-9ebc-005a262f3cbc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:05.540210 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3ef5-5f15-492b-9ebc-005a262f3cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:05.540706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3ef5-5f15-492b-9ebc-005a262f3cbc None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:05.542320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c3ef5-5f15-492b-9ebc-005a262f3cbc None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:05.544255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c3ef5-5f15-492b-9ebc-005a262f3cbc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:05.546502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 105/204] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:05 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:05.561582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3ef5-5f15-492b-9ebc-005a262f3cbc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:05.564920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bdb3f-52aa-4184-81a2-198c76729acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:05.566551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bdb3f-52aa-4184-81a2-198c76729acf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:05.675922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 100/205] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:05 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:05.683725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bdb3f-52aa-4184-81a2-198c76729acf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:05.753647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3ef5-5f15-492b-9ebc-005a262f3cbc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:05.774378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:05.823094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0921735-6460-4cbf-a6a9-f731ec71ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:05.823691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0921735-6460-4cbf-a6a9-f731ec71ff6e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:05.823973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0921735-6460-4cbf-a6a9-f731ec71ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:05.824245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0921735-6460-4cbf-a6a9-f731ec71ff6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:05.825080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0921735-6460-4cbf-a6a9-f731ec71ff6e None admin] RBAC: Adding query filter params (role.id=a1bdbf0d655e48afb678e720ec7d1d7a, scope.project.id=4148325ec8614e9bbea65c25532b96a0, user.id=5a5540023a4c4d54a454ccd6da170569) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:05.825389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0921735-6460-4cbf-a6a9-f731ec71ff6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:05.826837 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0921735-6460-4cbf-a6a9-f731ec71ff6e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:05.835907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 106/206] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:05 2022] GET /identity/v3/role_assignments?user.id=5a5540023a4c4d54a454ccd6da170569&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=a1bdbf0d655e48afb678e720ec7d1d7a => generated 610 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:05.837779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bdb3f-52aa-4184-81a2-198c76729acf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:05.882735 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c883c-7692-4074-be74-dbe7f71b3a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:05.883639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c883c-7692-4074-be74-dbe7f71b3a7b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:05.883923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c883c-7692-4074-be74-dbe7f71b3a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:05.884193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c883c-7692-4074-be74-dbe7f71b3a7b None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:05.885451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c883c-7692-4074-be74-dbe7f71b3a7b None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:05.886948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c883c-7692-4074-be74-dbe7f71b3a7b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:05.888772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 101/207] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:05 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:05.895319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0921735-6460-4cbf-a6a9-f731ec71ff6e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:05.927110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:06.014534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0921735-6460-4cbf-a6a9-f731ec71ff6e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:06.053308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af901397-e5fb-42ec-8a7c-23a28c1b83cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:06.053978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af901397-e5fb-42ec-8a7c-23a28c1b83cb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:06.054261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af901397-e5fb-42ec-8a7c-23a28c1b83cb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:06.054540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af901397-e5fb-42ec-8a7c-23a28c1b83cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:06.055393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af901397-e5fb-42ec-8a7c-23a28c1b83cb None admin] RBAC: Adding query filter params (role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca, user.id=5b51d2a00c9440e582bfcd1aae0d1701) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:06.055744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af901397-e5fb-42ec-8a7c-23a28c1b83cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:06.057216 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af901397-e5fb-42ec-8a7c-23a28c1b83cb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:06.063985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 107/208] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:05 2022] GET /identity/v3/role_assignments?user.id=5b51d2a00c9440e582bfcd1aae0d1701&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:07.465687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0645295-f9be-45e3-a59b-6aafc0ef1b19 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:07.466355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0645295-f9be-45e3-a59b-6aafc0ef1b19 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:07.466355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0645295-f9be-45e3-a59b-6aafc0ef1b19 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:07.467905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 102/209] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:07.473292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a5ef9-44ba-41c0-9998-b33e94670114 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:07.473798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a5ef9-44ba-41c0-9998-b33e94670114 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:07.473956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a5ef9-44ba-41c0-9998-b33e94670114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:07.492289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-102a5ef9-44ba-41c0-9998-b33e94670114 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:07.493459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-102a5ef9-44ba-41c0-9998-b33e94670114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:07.577978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 108/210] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:07.602265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0645295-f9be-45e3-a59b-6aafc0ef1b19 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:07.715870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0645295-f9be-45e3-a59b-6aafc0ef1b19 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:07.722291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d1918-3511-488e-a0bf-9df7c1868a02 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:07.722623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d1918-3511-488e-a0bf-9df7c1868a02 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:07.722843 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d1918-3511-488e-a0bf-9df7c1868a02 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:07.727592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 109/211] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:13:07.734150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b35345-286a-482a-9ceb-42eae915a862 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:07.734871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b35345-286a-482a-9ceb-42eae915a862 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:07.735173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b35345-286a-482a-9ceb-42eae915a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:07.753291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-54b35345-286a-482a-9ceb-42eae915a862 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:07.754619 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-54b35345-286a-482a-9ceb-42eae915a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:07.761046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b3753-ff1e-4dee-bb36-c05204f3275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:07.762108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b3753-ff1e-4dee-bb36-c05204f3275c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:07.762999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b3753-ff1e-4dee-bb36-c05204f3275c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:07.763479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b3753-ff1e-4dee-bb36-c05204f3275c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:07.767146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:07.770354 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:07.778119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b3753-ff1e-4dee-bb36-c05204f3275c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f14b3753-ff1e-4dee-bb36-c05204f3275c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:07.788704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:07.789625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:07.790434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:07.793196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 103/212] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:07.799413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b3753-ff1e-4dee-bb36-c05204f3275c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:07.846329 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 110/213] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:07.872674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b35345-286a-482a-9ceb-42eae915a862 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:07.930430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b3753-ff1e-4dee-bb36-c05204f3275c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:07.976589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a73ab-92d7-4365-890f-7b412564b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:07.977215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a73ab-92d7-4365-890f-7b412564b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:07.977500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a73ab-92d7-4365-890f-7b412564b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:07.977776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a73ab-92d7-4365-890f-7b412564b6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:07.978821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a73ab-92d7-4365-890f-7b412564b6e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:07.979133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a73ab-92d7-4365-890f-7b412564b6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:07.980829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a73ab-92d7-4365-890f-7b412564b6e8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:07.997403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 104/214] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:07 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:07.998787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a73ab-92d7-4365-890f-7b412564b6e8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:08.009115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b35345-286a-482a-9ceb-42eae915a862 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:08.057004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc51ea-1294-4e35-855d-565f4765c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:08.057827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc51ea-1294-4e35-855d-565f4765c166 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.058108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc51ea-1294-4e35-855d-565f4765c166 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.058389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc51ea-1294-4e35-855d-565f4765c166 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.059735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc51ea-1294-4e35-855d-565f4765c166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:08.061261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc51ea-1294-4e35-855d-565f4765c166 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:08.067672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 111/215] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:07 2022] GET /identity/v3/domains/default => generated 200 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:08.067672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bd8f4-9c25-44e9-9343-8f3a58bd448c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.067672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bd8f4-9c25-44e9-9343-8f3a58bd448c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.067672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bd8f4-9c25-44e9-9343-8f3a58bd448c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.067672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 112/216] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:08.071537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bd8f4-9c25-44e9-9343-8f3a58bd448c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:08.073044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:08.095509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:08.123251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a73ab-92d7-4365-890f-7b412564b6e8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:08.165350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdcf68-f8c3-4826-8d6a-10111ee9dfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:08.166460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcf68-f8c3-4826-8d6a-10111ee9dfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.167285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcf68-f8c3-4826-8d6a-10111ee9dfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.167475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdcf68-f8c3-4826-8d6a-10111ee9dfa7 None admin] PATH_INFO: `/v3/users/ce243c8ac90240c182a8c18edefd762d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.186299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdcf68-f8c3-4826-8d6a-10111ee9dfa7 None admin] RBAC: Authorizing `identity:get_user(user_id=ce243c8ac90240c182a8c18edefd762d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:08.187179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bd8f4-9c25-44e9-9343-8f3a58bd448c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:08.188271 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdcf68-f8c3-4826-8d6a-10111ee9dfa7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:08.190722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 105/217] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:07 2022] GET /identity/v3/users/ce243c8ac90240c182a8c18edefd762d => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:08.191593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1530b4e-4eb3-4035-a83c-83fe6f89157f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.191882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1530b4e-4eb3-4035-a83c-83fe6f89157f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.192256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1530b4e-4eb3-4035-a83c-83fe6f89157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.210965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b1530b4e-4eb3-4035-a83c-83fe6f89157f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:08.212565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b1530b4e-4eb3-4035-a83c-83fe6f89157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:08.229218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad800ba0-b91a-488c-b1f5-da9450aaeb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:08.229816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad800ba0-b91a-488c-b1f5-da9450aaeb68 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.230108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad800ba0-b91a-488c-b1f5-da9450aaeb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.230373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad800ba0-b91a-488c-b1f5-da9450aaeb68 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.231094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad800ba0-b91a-488c-b1f5-da9450aaeb68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:08.232866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad800ba0-b91a-488c-b1f5-da9450aaeb68 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:08.255102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 113/218] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:13:08 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:13:08.255998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad800ba0-b91a-488c-b1f5-da9450aaeb68 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:08.317559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 106/219] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:08.340854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1530b4e-4eb3-4035-a83c-83fe6f89157f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:08.357956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:08.395462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad800ba0-b91a-488c-b1f5-da9450aaeb68 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:08.402851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:08.433207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e59e94-dafc-43ce-87d2-396037cf1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:08.433872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e59e94-dafc-43ce-87d2-396037cf1e5a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.434157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e59e94-dafc-43ce-87d2-396037cf1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.434439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e59e94-dafc-43ce-87d2-396037cf1e5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.465614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1530b4e-4eb3-4035-a83c-83fe6f89157f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:08.510004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ea9f1-e4ca-45a0-b930-360760859bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:08.511981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ea9f1-e4ca-45a0-b930-360760859bed None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.512544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ea9f1-e4ca-45a0-b930-360760859bed None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.512836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ea9f1-e4ca-45a0-b930-360760859bed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.513255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e59e94-dafc-43ce-87d2-396037cf1e5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:08.514741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e59e94-dafc-43ce-87d2-396037cf1e5a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:08.529043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ea9f1-e4ca-45a0-b930-360760859bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8c6ea9f1-e4ca-45a0-b930-360760859bed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:08.538617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:08.539575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:08.540387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 107/220] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:08.543386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a34b1-0976-4624-b88d-5012e42a23f2 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.543386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a34b1-0976-4624-b88d-5012e42a23f2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.543386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a34b1-0976-4624-b88d-5012e42a23f2 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.543386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 108/221] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:08.546259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a34b1-0976-4624-b88d-5012e42a23f2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:08.606367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:08.645121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 114/222] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:08.646369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf5d0-4ba4-4ef8-b7a0-ad1a18178c8b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.646656 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf5d0-4ba4-4ef8-b7a0-ad1a18178c8b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.646929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf5d0-4ba4-4ef8-b7a0-ad1a18178c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.663181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-baabf5d0-4ba4-4ef8-b7a0-ad1a18178c8b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:08.664409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-baabf5d0-4ba4-4ef8-b7a0-ad1a18178c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:08.681031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a34b1-0976-4624-b88d-5012e42a23f2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:08.696280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:08.724893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72845ca3-27c6-47fd-a7ed-82c1a91b9d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:08.725560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72845ca3-27c6-47fd-a7ed-82c1a91b9d97 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.725846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72845ca3-27c6-47fd-a7ed-82c1a91b9d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.726125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72845ca3-27c6-47fd-a7ed-82c1a91b9d97 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.726879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72845ca3-27c6-47fd-a7ed-82c1a91b9d97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:08.727188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72845ca3-27c6-47fd-a7ed-82c1a91b9d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:08.728618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72845ca3-27c6-47fd-a7ed-82c1a91b9d97 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:08.738189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 109/223] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:08.739309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72845ca3-27c6-47fd-a7ed-82c1a91b9d97 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:08.746779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 115/224] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:08.751845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf5d0-4ba4-4ef8-b7a0-ad1a18178c8b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:08.863974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72845ca3-27c6-47fd-a7ed-82c1a91b9d97 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:08.887261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf5d0-4ba4-4ef8-b7a0-ad1a18178c8b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:08.889627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:08.906826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0003a-a7ab-4ef9-93b1-cd8226c200cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:08.907787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0003a-a7ab-4ef9-93b1-cd8226c200cc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.908082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0003a-a7ab-4ef9-93b1-cd8226c200cc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.908385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0003a-a7ab-4ef9-93b1-cd8226c200cc None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.909598 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0003a-a7ab-4ef9-93b1-cd8226c200cc None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:08.911361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0003a-a7ab-4ef9-93b1-cd8226c200cc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:08.913125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 110/225] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:08 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:08.918793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0003a-a7ab-4ef9-93b1-cd8226c200cc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:08.934704 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a9db-3ee8-4e96-a494-41838c01784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:08.936115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a9db-3ee8-4e96-a494-41838c01784f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:08.936993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a9db-3ee8-4e96-a494-41838c01784f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:08.938176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830a9db-3ee8-4e96-a494-41838c01784f None admin] PATH_INFO: `/v3/users/5b51d2a00c9440e582bfcd1aae0d1701` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:08.939894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830a9db-3ee8-4e96-a494-41838c01784f None admin] RBAC: Authorizing `identity:get_user(user_id=5b51d2a00c9440e582bfcd1aae0d1701)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:08.941897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830a9db-3ee8-4e96-a494-41838c01784f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:08.948371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 116/226] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:08 2022] GET /identity/v3/users/5b51d2a00c9440e582bfcd1aae0d1701 => generated 284 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:08.948371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a9db-3ee8-4e96-a494-41838c01784f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:08.967303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:09.039530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0003a-a7ab-4ef9-93b1-cd8226c200cc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:09.056134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830a9db-3ee8-4e96-a494-41838c01784f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:09.076910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36549f-dcc3-4bb4-9a60-1fb1f48850d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:09.078638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36549f-dcc3-4bb4-9a60-1fb1f48850d2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:09.079122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36549f-dcc3-4bb4-9a60-1fb1f48850d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:09.079675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36549f-dcc3-4bb4-9a60-1fb1f48850d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:09.090943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36549f-dcc3-4bb4-9a60-1fb1f48850d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:09.092506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100dfc-cdbf-4c23-a099-bd919573d6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:09.093155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100dfc-cdbf-4c23-a099-bd919573d6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:09.093466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100dfc-cdbf-4c23-a099-bd919573d6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:09.093739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d100dfc-cdbf-4c23-a099-bd919573d6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:09.094576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d100dfc-cdbf-4c23-a099-bd919573d6a7 None admin] RBAC: Adding query filter params (role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca, user.id=ce243c8ac90240c182a8c18edefd762d) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:09.094885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d100dfc-cdbf-4c23-a099-bd919573d6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:09.096462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d100dfc-cdbf-4c23-a099-bd919573d6a7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-fc36549f-dcc3-4bb4-9a60-1fb1f48850d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:09.101128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:09.102009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:09.102807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:09.103431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 117/227] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:08 2022] GET /identity/v3/role_assignments?user.id=ce243c8ac90240c182a8c18edefd762d&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:09.105111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 111/228] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:09.107585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100dfc-cdbf-4c23-a099-bd919573d6a7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:09.120356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36549f-dcc3-4bb4-9a60-1fb1f48850d2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:09.156032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:09.226728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d100dfc-cdbf-4c23-a099-bd919573d6a7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:09.271591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62283f2f-98e3-40f9-b4da-c8941b268deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:09.271591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62283f2f-98e3-40f9-b4da-c8941b268deb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:09.271591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62283f2f-98e3-40f9-b4da-c8941b268deb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:09.271591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62283f2f-98e3-40f9-b4da-c8941b268deb None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:09.272103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62283f2f-98e3-40f9-b4da-c8941b268deb None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:09.272103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62283f2f-98e3-40f9-b4da-c8941b268deb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:09.274611 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 118/229] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:09 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:09.281053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62283f2f-98e3-40f9-b4da-c8941b268deb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:09.302578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:09.314136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36549f-dcc3-4bb4-9a60-1fb1f48850d2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:09.385926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c484-ad86-4f31-afc4-6ba086780b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:09.386932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c484-ad86-4f31-afc4-6ba086780b76 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:09.387388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c484-ad86-4f31-afc4-6ba086780b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:09.387868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c484-ad86-4f31-afc4-6ba086780b76 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:09.388820 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899c484-ad86-4f31-afc4-6ba086780b76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:09.389304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899c484-ad86-4f31-afc4-6ba086780b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:09.391042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899c484-ad86-4f31-afc4-6ba086780b76 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:09.397648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62283f2f-98e3-40f9-b4da-c8941b268deb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:09.399345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:09.412052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 112/230] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:09 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:09.428162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c484-ad86-4f31-afc4-6ba086780b76 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:09.447580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac3591-1283-44ba-b9d6-aa14b4b066e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:09.447580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac3591-1283-44ba-b9d6-aa14b4b066e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:09.447580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac3591-1283-44ba-b9d6-aa14b4b066e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:09.447580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac3591-1283-44ba-b9d6-aa14b4b066e7 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/users/5b51d2a00c9440e582bfcd1aae0d1701/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:09.448577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac3591-1283-44ba-b9d6-aa14b4b066e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cda8b9fce6604ccbaa4b14c8377676ca, user_id=5b51d2a00c9440e582bfcd1aae0d1701, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:09.450284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac3591-1283-44ba-b9d6-aa14b4b066e7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:09.475794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 119/231] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:13:09 2022] PUT /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/users/5b51d2a00c9440e582bfcd1aae0d1701/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:13:09.602877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c484-ad86-4f31-afc4-6ba086780b76 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:09.670592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e481-42b1-49c8-8c79-9b70c18b49d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:09.671442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e481-42b1-49c8-8c79-9b70c18b49d2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:09.671762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e481-42b1-49c8-8c79-9b70c18b49d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:09.672044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e481-42b1-49c8-8c79-9b70c18b49d2 None admin] PATH_INFO: `/v3/users/5b51d2a00c9440e582bfcd1aae0d1701` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:09.673327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9e481-42b1-49c8-8c79-9b70c18b49d2 None admin] RBAC: Authorizing `identity:get_user(user_id=5b51d2a00c9440e582bfcd1aae0d1701)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:09.674827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9e481-42b1-49c8-8c79-9b70c18b49d2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:09.676579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 113/232] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:09 2022] GET /identity/v3/users/5b51d2a00c9440e582bfcd1aae0d1701 => generated 284 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:09.682312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac3591-1283-44ba-b9d6-aa14b4b066e7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:09.809735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac3591-1283-44ba-b9d6-aa14b4b066e7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:09.845806 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8f2a2-6ff3-4d77-b2a4-a4782c970415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:09.846667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8f2a2-6ff3-4d77-b2a4-a4782c970415 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:09.846946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8f2a2-6ff3-4d77-b2a4-a4782c970415 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:09.847222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8f2a2-6ff3-4d77-b2a4-a4782c970415 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:09.848438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8f2a2-6ff3-4d77-b2a4-a4782c970415 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:09.849903 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8f2a2-6ff3-4d77-b2a4-a4782c970415 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:09.851615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 120/233] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:09 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:09.857625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e481-42b1-49c8-8c79-9b70c18b49d2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:09.890247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:10.004841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e481-42b1-49c8-8c79-9b70c18b49d2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:10.056872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dcd05-8cd7-4b64-8e77-f81b94406195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:10.057781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dcd05-8cd7-4b64-8e77-f81b94406195 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:10.058058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dcd05-8cd7-4b64-8e77-f81b94406195 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:10.058327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dcd05-8cd7-4b64-8e77-f81b94406195 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/users/5b51d2a00c9440e582bfcd1aae0d1701/roles/45adf513980e4f8a9eab6f81b4fd8b77` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:10.060588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dcd05-8cd7-4b64-8e77-f81b94406195 None admin] RBAC: Authorizing `identity:create_grant(project_id=cda8b9fce6604ccbaa4b14c8377676ca, user_id=5b51d2a00c9440e582bfcd1aae0d1701, role_id=45adf513980e4f8a9eab6f81b4fd8b77)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:10.062625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dcd05-8cd7-4b64-8e77-f81b94406195 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:10.084061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 114/234] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:13:09 2022] PUT /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/users/5b51d2a00c9440e582bfcd1aae0d1701/roles/45adf513980e4f8a9eab6f81b4fd8b77 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:13:10.957231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7e7d-65ff-4bda-aaf6-3cafb8354b94 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:10.957752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7e7d-65ff-4bda-aaf6-3cafb8354b94 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:10.957752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df7e7d-65ff-4bda-aaf6-3cafb8354b94 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:10.959442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 121/235] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:10.964523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706adc8-e276-49ea-bb59-cbd81161eecb None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:10.964930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706adc8-e276-49ea-bb59-cbd81161eecb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:10.965102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706adc8-e276-49ea-bb59-cbd81161eecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:10.988921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a706adc8-e276-49ea-bb59-cbd81161eecb None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:10.990134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a706adc8-e276-49ea-bb59-cbd81161eecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:11.001841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb54bd4-cfa6-4993-a4cd-51b5c649a7cb None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:11.002123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb54bd4-cfa6-4993-a4cd-51b5c649a7cb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:11.002386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb54bd4-cfa6-4993-a4cd-51b5c649a7cb None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:11.004113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 122/236] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:13:11.009570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79bd56-48d0-43ae-bc9d-273552915f98 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:11.009854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79bd56-48d0-43ae-bc9d-273552915f98 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:11.010127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79bd56-48d0-43ae-bc9d-273552915f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:11.035841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2b79bd56-48d0-43ae-bc9d-273552915f98 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:11.037032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2b79bd56-48d0-43ae-bc9d-273552915f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:11.062252 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:11.112839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 123/237] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:11.135635 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79bd56-48d0-43ae-bc9d-273552915f98 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:11.145001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 115/238] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:11.182464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706adc8-e276-49ea-bb59-cbd81161eecb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:11.217563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:11.279471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79bd56-48d0-43ae-bc9d-273552915f98 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:11.324750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706adc8-e276-49ea-bb59-cbd81161eecb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:11.325776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf441d24-e5b7-425c-9e40-e673feb20043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:11.326656 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf441d24-e5b7-425c-9e40-e673feb20043 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:11.327022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf441d24-e5b7-425c-9e40-e673feb20043 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:11.327367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf441d24-e5b7-425c-9e40-e673feb20043 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:11.348783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf441d24-e5b7-425c-9e40-e673feb20043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:11.360689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8da65-e2be-4bf8-96e3-9a9f64913070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:11.361466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8da65-e2be-4bf8-96e3-9a9f64913070 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:11.361748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8da65-e2be-4bf8-96e3-9a9f64913070 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:11.362026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8da65-e2be-4bf8-96e3-9a9f64913070 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:11.363203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8da65-e2be-4bf8-96e3-9a9f64913070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-cf441d24-e5b7-425c-9e40-e673feb20043 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:11.363575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:11.364450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:11.365260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:11.365890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8da65-e2be-4bf8-96e3-9a9f64913070 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:11.365959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 124/239] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:13:11.367154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 116/240] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:11.372710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf441d24-e5b7-425c-9e40-e673feb20043 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:11.377463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8da65-e2be-4bf8-96e3-9a9f64913070 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:11.427001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:11.491770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:11.523624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8da65-e2be-4bf8-96e3-9a9f64913070 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:11.571310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771dec5-a95d-46fe-b63c-eb3e62865715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:11.572012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771dec5-a95d-46fe-b63c-eb3e62865715 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:11.572290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771dec5-a95d-46fe-b63c-eb3e62865715 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:11.572559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771dec5-a95d-46fe-b63c-eb3e62865715 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:11.573304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771dec5-a95d-46fe-b63c-eb3e62865715 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:11.573605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771dec5-a95d-46fe-b63c-eb3e62865715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:11.574983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771dec5-a95d-46fe-b63c-eb3e62865715 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:11.585532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 117/241] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:11 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:11.591197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771dec5-a95d-46fe-b63c-eb3e62865715 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:11.621714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf441d24-e5b7-425c-9e40-e673feb20043 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:11.715643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771dec5-a95d-46fe-b63c-eb3e62865715 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:11.728770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bfdf9-207d-450c-9a0d-d323822d1bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:11.729444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bfdf9-207d-450c-9a0d-d323822d1bd4 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:11.729721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bfdf9-207d-450c-9a0d-d323822d1bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:11.729990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bfdf9-207d-450c-9a0d-d323822d1bd4 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:11.730713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bfdf9-207d-450c-9a0d-d323822d1bd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:11.732501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bfdf9-207d-450c-9a0d-d323822d1bd4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:11.770747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 125/242] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:13:11 2022] POST /identity/v3/users => generated 294 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:13:11.782816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f7fda-fed6-4150-92e9-a0cde561fe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:11.783895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7fda-fed6-4150-92e9-a0cde561fe01 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:11.784235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7fda-fed6-4150-92e9-a0cde561fe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:11.784586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7fda-fed6-4150-92e9-a0cde561fe01 None admin] PATH_INFO: `/v3/users/2bcad56ce79640079bda31eb1b5d9ad3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:11.801829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f7fda-fed6-4150-92e9-a0cde561fe01 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcad56ce79640079bda31eb1b5d9ad3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:11.803888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f7fda-fed6-4150-92e9-a0cde561fe01 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:11.806794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 118/243] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:11 2022] GET /identity/v3/users/2bcad56ce79640079bda31eb1b5d9ad3 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:11.812881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bfdf9-207d-450c-9a0d-d323822d1bd4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:11.942296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:11.979986 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bfdf9-207d-450c-9a0d-d323822d1bd4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:12.037538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d16e-f39d-415a-9583-1d7a94bf1638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:12.038568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d16e-f39d-415a-9583-1d7a94bf1638 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:12.039056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d16e-f39d-415a-9583-1d7a94bf1638 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:12.039535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d16e-f39d-415a-9583-1d7a94bf1638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:12.127826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d16e-f39d-415a-9583-1d7a94bf1638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:12.129872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d16e-f39d-415a-9583-1d7a94bf1638 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:12.154553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be03beb-93f9-4d68-9972-408049702fb9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:12.154553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be03beb-93f9-4d68-9972-408049702fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:12.154553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be03beb-93f9-4d68-9972-408049702fb9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:12.156163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 119/244] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:12.165809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10056199-3a5e-4dac-bc48-9c34a44d2d59 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:12.166170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10056199-3a5e-4dac-bc48-9c34a44d2d59 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:12.166419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10056199-3a5e-4dac-bc48-9c34a44d2d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:12.175202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:12.196245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-10056199-3a5e-4dac-bc48-9c34a44d2d59 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:12.198514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-10056199-3a5e-4dac-bc48-9c34a44d2d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:12.247471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:12.291169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 126/245] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:12.292697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d16e-f39d-415a-9583-1d7a94bf1638 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:12.303812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 120/246] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:12.327508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10056199-3a5e-4dac-bc48-9c34a44d2d59 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:12.424666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d16e-f39d-415a-9583-1d7a94bf1638 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:12.454897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10056199-3a5e-4dac-bc48-9c34a44d2d59 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:12.462153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28307b6a-f66b-4328-b63b-3ff5a39ccab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:12.463014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28307b6a-f66b-4328-b63b-3ff5a39ccab1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:12.463295 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28307b6a-f66b-4328-b63b-3ff5a39ccab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:12.463603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28307b6a-f66b-4328-b63b-3ff5a39ccab1 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:12.465094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28307b6a-f66b-4328-b63b-3ff5a39ccab1 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:12.466270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28307b6a-f66b-4328-b63b-3ff5a39ccab1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:12.469195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 127/247] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:12 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:12.475266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28307b6a-f66b-4328-b63b-3ff5a39ccab1 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:12.496996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20867f53-e927-41b6-9612-377ed6ed76b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:12.498185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20867f53-e927-41b6-9612-377ed6ed76b0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:12.498663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20867f53-e927-41b6-9612-377ed6ed76b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:12.499129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20867f53-e927-41b6-9612-377ed6ed76b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:12.512035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20867f53-e927-41b6-9612-377ed6ed76b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-20867f53-e927-41b6-9612-377ed6ed76b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:12.521211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:12.522143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:12.522954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:12.525726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 121/248] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:13:12.525978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:12.527479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:12.534360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20867f53-e927-41b6-9612-377ed6ed76b0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:12.599366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28307b6a-f66b-4328-b63b-3ff5a39ccab1 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:12.638824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78572a6a-7b35-4f79-afea-acebe983df6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:12.640000 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78572a6a-7b35-4f79-afea-acebe983df6e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:12.641025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78572a6a-7b35-4f79-afea-acebe983df6e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:12.641522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78572a6a-7b35-4f79-afea-acebe983df6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:12.642575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78572a6a-7b35-4f79-afea-acebe983df6e None admin] RBAC: Adding query filter params (role.id=a1bdbf0d655e48afb678e720ec7d1d7a, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca, user.id=2bcad56ce79640079bda31eb1b5d9ad3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:12.643172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78572a6a-7b35-4f79-afea-acebe983df6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:12.644991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78572a6a-7b35-4f79-afea-acebe983df6e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:12.651598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 128/249] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:12 2022] GET /identity/v3/role_assignments?user.id=2bcad56ce79640079bda31eb1b5d9ad3&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=a1bdbf0d655e48afb678e720ec7d1d7a => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:12.655580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20867f53-e927-41b6-9612-377ed6ed76b0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:12.701422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a242e6-f56a-465a-92ce-72f8d2ebcb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:12.702114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a242e6-f56a-465a-92ce-72f8d2ebcb50 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:12.702393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a242e6-f56a-465a-92ce-72f8d2ebcb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:12.703265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a242e6-f56a-465a-92ce-72f8d2ebcb50 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:12.704055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a242e6-f56a-465a-92ce-72f8d2ebcb50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:12.704359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a242e6-f56a-465a-92ce-72f8d2ebcb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:12.705763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a242e6-f56a-465a-92ce-72f8d2ebcb50 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:12.708896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a34a-c254-4db9-b391-b0b2d9a2400d None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:12.709419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a34a-c254-4db9-b391-b0b2d9a2400d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:12.709916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50a34a-c254-4db9-b391-b0b2d9a2400d None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:12.711620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 129/250] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:13:12.715224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 122/251] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:12 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:12.717472 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba95860-4a98-4793-ab2d-a7425b20677a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:12.718027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba95860-4a98-4793-ab2d-a7425b20677a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:12.719104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba95860-4a98-4793-ab2d-a7425b20677a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:12.721770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a242e6-f56a-465a-92ce-72f8d2ebcb50 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:12.738696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0ba95860-4a98-4793-ab2d-a7425b20677a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:12.740248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0ba95860-4a98-4793-ab2d-a7425b20677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:12.795532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:12.823129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 130/252] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:12.850785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba95860-4a98-4793-ab2d-a7425b20677a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:12.898147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:12.900018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a242e6-f56a-465a-92ce-72f8d2ebcb50 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:12.965649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba95860-4a98-4793-ab2d-a7425b20677a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:13.004361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91d7c-278a-46aa-a12a-9efb165d915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:13.005962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91d7c-278a-46aa-a12a-9efb165d915a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.007242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91d7c-278a-46aa-a12a-9efb165d915a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.007532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91d7c-278a-46aa-a12a-9efb165d915a None admin] PATH_INFO: `/v3/users/ce243c8ac90240c182a8c18edefd762d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.007784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91a3a2-21ed-4fd9-bc3d-7f9e7570fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:13.008884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91d7c-278a-46aa-a12a-9efb165d915a None admin] RBAC: Authorizing `identity:get_user(user_id=ce243c8ac90240c182a8c18edefd762d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:13.009381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91a3a2-21ed-4fd9-bc3d-7f9e7570fc87 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.009872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91a3a2-21ed-4fd9-bc3d-7f9e7570fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.010340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91a3a2-21ed-4fd9-bc3d-7f9e7570fc87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.010442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91d7c-278a-46aa-a12a-9efb165d915a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:13.012454 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 123/253] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:12 2022] GET /identity/v3/users/ce243c8ac90240c182a8c18edefd762d => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:13.014244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8072-7dac-4a7f-9156-b8e4c49c4ae8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.014244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8072-7dac-4a7f-9156-b8e4c49c4ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.014520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8072-7dac-4a7f-9156-b8e4c49c4ae8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.016480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 124/254] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:13.021925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8072-7dac-4a7f-9156-b8e4c49c4ae8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:13.025238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91a3a2-21ed-4fd9-bc3d-7f9e7570fc87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-6d91a3a2-21ed-4fd9-bc3d-7f9e7570fc87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:13.034079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:13.035067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:13.035909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 131/255] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:13:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:13.037360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4167fab-c6a2-4a8e-a6e4-4e2a4fd8f133 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.037360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4167fab-c6a2-4a8e-a6e4-4e2a4fd8f133 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.037360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4167fab-c6a2-4a8e-a6e4-4e2a4fd8f133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.069464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b4167fab-c6a2-4a8e-a6e4-4e2a4fd8f133 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:13.070696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b4167fab-c6a2-4a8e-a6e4-4e2a4fd8f133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:13.144209 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 132/256] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:13.145088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4167fab-c6a2-4a8e-a6e4-4e2a4fd8f133 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:13.181882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:13.217384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8072-7dac-4a7f-9156-b8e4c49c4ae8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:13.252035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:13.262652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ead431-6ea1-4495-837d-adb98ec5b135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:13.263908 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ead431-6ea1-4495-837d-adb98ec5b135 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.264414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ead431-6ea1-4495-837d-adb98ec5b135 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.264882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ead431-6ea1-4495-837d-adb98ec5b135 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.266502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ead431-6ea1-4495-837d-adb98ec5b135 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:13.268184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ead431-6ea1-4495-837d-adb98ec5b135 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:13.270517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 125/257] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:13 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:13.271501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ead431-6ea1-4495-837d-adb98ec5b135 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:13.307238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4167fab-c6a2-4a8e-a6e4-4e2a4fd8f133 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:13.370877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bb044-279c-4dd9-b109-c0966e10ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:13.371656 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bb044-279c-4dd9-b109-c0966e10ca8a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.371856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bb044-279c-4dd9-b109-c0966e10ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.372118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bb044-279c-4dd9-b109-c0966e10ca8a None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.372870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bb044-279c-4dd9-b109-c0966e10ca8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:13.373172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bb044-279c-4dd9-b109-c0966e10ca8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:13.375437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bb044-279c-4dd9-b109-c0966e10ca8a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:13.381270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ead431-6ea1-4495-837d-adb98ec5b135 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:13.393610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 133/258] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:13.394620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bb044-279c-4dd9-b109-c0966e10ca8a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:13.420952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f08854-ce9b-4af4-913c-7b72636c5dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:13.424008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f08854-ce9b-4af4-913c-7b72636c5dbe None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.424711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f08854-ce9b-4af4-913c-7b72636c5dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.425860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f08854-ce9b-4af4-913c-7b72636c5dbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.443861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f08854-ce9b-4af4-913c-7b72636c5dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c5f08854-ce9b-4af4-913c-7b72636c5dbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:13.458388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:13.459339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:13.460159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:13.471580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 126/259] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:13.473086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f08854-ce9b-4af4-913c-7b72636c5dbe None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:13.520325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:13.525590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bb044-279c-4dd9-b109-c0966e10ca8a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:13.563484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3716b-a6a2-4810-b9f0-9a8a476e69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:13.564401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3716b-a6a2-4810-b9f0-9a8a476e69e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.564681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3716b-a6a2-4810-b9f0-9a8a476e69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.564952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3716b-a6a2-4810-b9f0-9a8a476e69e3 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/users/ce243c8ac90240c182a8c18edefd762d/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.569409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3716b-a6a2-4810-b9f0-9a8a476e69e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=cda8b9fce6604ccbaa4b14c8377676ca, user_id=ce243c8ac90240c182a8c18edefd762d, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:13.570901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3716b-a6a2-4810-b9f0-9a8a476e69e3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:13.581448 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:13.586750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 134/260] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:13:13 2022] PUT /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/users/ce243c8ac90240c182a8c18edefd762d/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:13:13.588087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3716b-a6a2-4810-b9f0-9a8a476e69e3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:13.710521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3716b-a6a2-4810-b9f0-9a8a476e69e3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:13.711125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f08854-ce9b-4af4-913c-7b72636c5dbe None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:13.753095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf0e26-c9f5-458b-8d1c-6351bdeb9cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:13.753789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf0e26-c9f5-458b-8d1c-6351bdeb9cdc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.754071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf0e26-c9f5-458b-8d1c-6351bdeb9cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.754345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf0e26-c9f5-458b-8d1c-6351bdeb9cdc None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.755128 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf0e26-c9f5-458b-8d1c-6351bdeb9cdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:13.755435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf0e26-c9f5-458b-8d1c-6351bdeb9cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:13.757156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf0e26-c9f5-458b-8d1c-6351bdeb9cdc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:13.768567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 135/261] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:13 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:13.774959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf0e26-c9f5-458b-8d1c-6351bdeb9cdc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:13.778871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521899c1-8eb8-4e66-9547-a9c022e08926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:13.780011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521899c1-8eb8-4e66-9547-a9c022e08926 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.780533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521899c1-8eb8-4e66-9547-a9c022e08926 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.781544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521899c1-8eb8-4e66-9547-a9c022e08926 None admin] PATH_INFO: `/v3/users/5b51d2a00c9440e582bfcd1aae0d1701` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.782999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521899c1-8eb8-4e66-9547-a9c022e08926 None admin] RBAC: Authorizing `identity:get_user(user_id=5b51d2a00c9440e582bfcd1aae0d1701)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:13.784804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521899c1-8eb8-4e66-9547-a9c022e08926 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:13.791578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 127/262] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:13 2022] GET /identity/v3/users/5b51d2a00c9440e582bfcd1aae0d1701 => generated 284 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:13.792943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521899c1-8eb8-4e66-9547-a9c022e08926 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:13.802455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:13.905382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf0e26-c9f5-458b-8d1c-6351bdeb9cdc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:13.971066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0933d-70e2-4d55-bd1f-99b162866d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:13.972203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0933d-70e2-4d55-bd1f-99b162866d19 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:13.972537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0933d-70e2-4d55-bd1f-99b162866d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:13.972823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0933d-70e2-4d55-bd1f-99b162866d19 None admin] PATH_INFO: `/v3/users/5b51d2a00c9440e582bfcd1aae0d1701` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:13.974196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0933d-70e2-4d55-bd1f-99b162866d19 None admin] RBAC: Authorizing `identity:get_user(user_id=5b51d2a00c9440e582bfcd1aae0d1701)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:13.976085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0933d-70e2-4d55-bd1f-99b162866d19 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:13.978562 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 136/263] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:13 2022] GET /identity/v3/users/5b51d2a00c9440e582bfcd1aae0d1701 => generated 284 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:13.985131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0933d-70e2-4d55-bd1f-99b162866d19 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:14.017686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521899c1-8eb8-4e66-9547-a9c022e08926 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:14.059612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:14.081899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:14.100265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570a845-0b71-4899-8de5-6dc8fe69b1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:14.100934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a845-0b71-4899-8de5-6dc8fe69b1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:14.101214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a845-0b71-4899-8de5-6dc8fe69b1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:14.101491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a845-0b71-4899-8de5-6dc8fe69b1f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:14.102386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0933d-70e2-4d55-bd1f-99b162866d19 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:14.143830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0177a-ae7c-451f-b042-d88efa966a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:14.144806 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0177a-ae7c-451f-b042-d88efa966a61 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:14.145100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0177a-ae7c-451f-b042-d88efa966a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:14.145386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0177a-ae7c-451f-b042-d88efa966a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:14.230057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0177a-ae7c-451f-b042-d88efa966a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:14.231474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0177a-ae7c-451f-b042-d88efa966a61 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:14.301414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570a845-0b71-4899-8de5-6dc8fe69b1f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:14.302911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570a845-0b71-4899-8de5-6dc8fe69b1f5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:14.360004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:14.368478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 137/264] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:14.389269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0177a-ae7c-451f-b042-d88efa966a61 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:14.441078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 128/265] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:14.447348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570a845-0b71-4899-8de5-6dc8fe69b1f5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:14.471982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:14.566519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570a845-0b71-4899-8de5-6dc8fe69b1f5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:14.584108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0177a-ae7c-451f-b042-d88efa966a61 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:14.607410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bc95f-71d9-4a05-bd35-5a54fad462ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:14.608661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bc95f-71d9-4a05-bd35-5a54fad462ec None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:14.609477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bc95f-71d9-4a05-bd35-5a54fad462ec None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:14.609766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bc95f-71d9-4a05-bd35-5a54fad462ec None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:14.611640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bc95f-71d9-4a05-bd35-5a54fad462ec None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:14.613424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bc95f-71d9-4a05-bd35-5a54fad462ec None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:14.615735 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 129/266] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:14 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:14.621444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bc95f-71d9-4a05-bd35-5a54fad462ec None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:14.635326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8480b3b-be7b-44ab-850c-18d64e6f74a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:14.636230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480b3b-be7b-44ab-850c-18d64e6f74a8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:14.636612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480b3b-be7b-44ab-850c-18d64e6f74a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:14.636894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480b3b-be7b-44ab-850c-18d64e6f74a8 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:14.638207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8480b3b-be7b-44ab-850c-18d64e6f74a8 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:14.639708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8480b3b-be7b-44ab-850c-18d64e6f74a8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:14.642505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 138/267] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:14 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:14.663856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8480b3b-be7b-44ab-850c-18d64e6f74a8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:14.719212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:14.731776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bc95f-71d9-4a05-bd35-5a54fad462ec None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:14.743237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:14.769881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fcd87-a9fc-47d0-8625-d76ee51ba159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:14.770574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fcd87-a9fc-47d0-8625-d76ee51ba159 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:14.770859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fcd87-a9fc-47d0-8625-d76ee51ba159 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:14.771137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fcd87-a9fc-47d0-8625-d76ee51ba159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:14.772015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fcd87-a9fc-47d0-8625-d76ee51ba159 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca, user.id=5b51d2a00c9440e582bfcd1aae0d1701) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:14.772330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fcd87-a9fc-47d0-8625-d76ee51ba159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:14.774228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fcd87-a9fc-47d0-8625-d76ee51ba159 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:14.783219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 130/268] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:14 2022] GET /identity/v3/role_assignments?user.id=5b51d2a00c9440e582bfcd1aae0d1701&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:14.805812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8480b3b-be7b-44ab-850c-18d64e6f74a8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:14.865258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f299a6-ab26-4ed4-bcee-6c635b534cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:14.865846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f299a6-ab26-4ed4-bcee-6c635b534cbc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:14.866125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f299a6-ab26-4ed4-bcee-6c635b534cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:14.866397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f299a6-ab26-4ed4-bcee-6c635b534cbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:14.867244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f299a6-ab26-4ed4-bcee-6c635b534cbc None admin] RBAC: Adding query filter params (role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca, user.id=5b51d2a00c9440e582bfcd1aae0d1701) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:14.867570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f299a6-ab26-4ed4-bcee-6c635b534cbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:14.869174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f299a6-ab26-4ed4-bcee-6c635b534cbc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:14.879592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 139/269] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:14 2022] GET /identity/v3/role_assignments?user.id=5b51d2a00c9440e582bfcd1aae0d1701&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 610 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:15.469549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e723-8a0a-40d3-8ae6-5c9189ed72bd None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:15.470032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e723-8a0a-40d3-8ae6-5c9189ed72bd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:15.470032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e723-8a0a-40d3-8ae6-5c9189ed72bd None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:15.471656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 131/270] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:15.478481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fe8a1-291c-49d5-a563-44b62d0aaec7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:15.478922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fe8a1-291c-49d5-a563-44b62d0aaec7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:15.479100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fe8a1-291c-49d5-a563-44b62d0aaec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:15.500668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5b0fe8a1-291c-49d5-a563-44b62d0aaec7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:15.501886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5b0fe8a1-291c-49d5-a563-44b62d0aaec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:15.588079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 140/271] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:15.615435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40e723-8a0a-40d3-8ae6-5c9189ed72bd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:15.665292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33825-c93c-4d1b-bf4d-89a5029b451a None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:15.665671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33825-c93c-4d1b-bf4d-89a5029b451a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:15.665840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a33825-c93c-4d1b-bf4d-89a5029b451a None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:15.667262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 141/272] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:15.673155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48231da6-e94e-4048-8189-b89e9e009118 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:15.673466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48231da6-e94e-4048-8189-b89e9e009118 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:15.673712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48231da6-e94e-4048-8189-b89e9e009118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:15.697609 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-48231da6-e94e-4048-8189-b89e9e009118 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:15.698829 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-48231da6-e94e-4048-8189-b89e9e009118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:15.746549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40e723-8a0a-40d3-8ae6-5c9189ed72bd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:15.753286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:15.783760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7c72c-4675-4438-92d1-6973895a6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:15.784552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7c72c-4675-4438-92d1-6973895a6b88 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:15.784831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7c72c-4675-4438-92d1-6973895a6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:15.785105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7c72c-4675-4438-92d1-6973895a6b88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:15.791405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 142/273] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:15.799594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7c72c-4675-4438-92d1-6973895a6b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5da7c72c-4675-4438-92d1-6973895a6b88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:15.803779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:15.804661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:15.805477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:15.806094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 132/274] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:15.812976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48231da6-e94e-4048-8189-b89e9e009118 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:15.820437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7c72c-4675-4438-92d1-6973895a6b88 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:15.856168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:15.920072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48231da6-e94e-4048-8189-b89e9e009118 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:15.925979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7c72c-4675-4438-92d1-6973895a6b88 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:15.956330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5e885-979e-4b7d-9024-a85018de798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:15.957336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e885-979e-4b7d-9024-a85018de798e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:15.957818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e885-979e-4b7d-9024-a85018de798e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:15.958295 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e885-979e-4b7d-9024-a85018de798e None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:15.959338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5e885-979e-4b7d-9024-a85018de798e None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:15.960050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5e885-979e-4b7d-9024-a85018de798e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:15.961891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5e885-979e-4b7d-9024-a85018de798e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:15.965496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b7e1-6577-4bbc-b7a4-728db544d1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:15.966291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b7e1-6577-4bbc-b7a4-728db544d1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:15.966571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b7e1-6577-4bbc-b7a4-728db544d1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:15.966843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b7e1-6577-4bbc-b7a4-728db544d1b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:15.968598 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572b7e1-6577-4bbc-b7a4-728db544d1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:15.970606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572b7e1-6577-4bbc-b7a4-728db544d1b5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:15.972641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 133/275] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:15 2022] GET /identity/v3/domains/default => generated 200 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:15.974318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 143/276] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:15 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:15.979914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5e885-979e-4b7d-9024-a85018de798e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:15.980579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b7e1-6577-4bbc-b7a4-728db544d1b5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:16.017860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:16.074284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:16.095372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5e885-979e-4b7d-9024-a85018de798e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:16.098823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b7e1-6577-4bbc-b7a4-728db544d1b5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:16.130274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b154b-2243-4db7-b4df-01cdc68475e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:16.130944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b154b-2243-4db7-b4df-01cdc68475e2 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.131224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b154b-2243-4db7-b4df-01cdc68475e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.131503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b154b-2243-4db7-b4df-01cdc68475e2 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.132241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b154b-2243-4db7-b4df-01cdc68475e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:16.133679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b154b-2243-4db7-b4df-01cdc68475e2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:16.144032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ee513-2e54-4775-a6fc-ba1cbbf90449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:16.145305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ee513-2e54-4775-a6fc-ba1cbbf90449 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.145749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ee513-2e54-4775-a6fc-ba1cbbf90449 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.146393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ee513-2e54-4775-a6fc-ba1cbbf90449 None admin] PATH_INFO: `/v3/users/4639cc99b6344e0687e355d934cec591` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.166224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 144/277] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:13:15 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:13:16.168100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6384a8-4c60-41ba-b134-e0a2c86345e7 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.168532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6384a8-4c60-41ba-b134-e0a2c86345e7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.168946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6384a8-4c60-41ba-b134-e0a2c86345e7 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.170565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 145/278] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:16.177961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b825a0-d179-4622-a218-386212a63339 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.178410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b825a0-d179-4622-a218-386212a63339 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.178549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ee513-2e54-4775-a6fc-ba1cbbf90449 None admin] RBAC: Authorizing `identity:get_user(user_id=4639cc99b6344e0687e355d934cec591)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:16.178989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b825a0-d179-4622-a218-386212a63339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.180201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ee513-2e54-4775-a6fc-ba1cbbf90449 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:16.182695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 134/279] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:15 2022] GET /identity/v3/users/4639cc99b6344e0687e355d934cec591 => generated 294 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:16.190410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ee513-2e54-4775-a6fc-ba1cbbf90449 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:16.204513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d9b825a0-d179-4622-a218-386212a63339 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:16.205987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d9b825a0-d179-4622-a218-386212a63339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:16.306486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 146/280] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:16.320751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ee513-2e54-4775-a6fc-ba1cbbf90449 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:16.329011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b825a0-d179-4622-a218-386212a63339 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:16.352915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:16.376327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e09eed-643a-464b-8b0e-8f52504569be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:16.377585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e09eed-643a-464b-8b0e-8f52504569be None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.379272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e09eed-643a-464b-8b0e-8f52504569be None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.379777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e09eed-643a-464b-8b0e-8f52504569be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.381183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e09eed-643a-464b-8b0e-8f52504569be None admin] RBAC: Adding query filter params (role.id=0048b2f4edbf4a69a99a3d1225c90e18, user.id=4639cc99b6344e0687e355d934cec591, scope.system=all) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:16.381697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e09eed-643a-464b-8b0e-8f52504569be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:16.383341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e09eed-643a-464b-8b0e-8f52504569be None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:16.391418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 135/281] 10.222.0.112 () {56 vars in 1313 bytes} [Fri Jun 3 16:13:16 2022] GET /identity/v3/role_assignments?user.id=4639cc99b6344e0687e355d934cec591&scope.system=all&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 227 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:16.468436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b825a0-d179-4622-a218-386212a63339 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:16.509949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696df793-4a19-4783-b62d-b3034bde4869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:16.511472 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696df793-4a19-4783-b62d-b3034bde4869 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.511956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696df793-4a19-4783-b62d-b3034bde4869 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.512386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696df793-4a19-4783-b62d-b3034bde4869 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.527265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696df793-4a19-4783-b62d-b3034bde4869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-696df793-4a19-4783-b62d-b3034bde4869 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:16.535867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:16.536999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:16.537993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 147/282] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:13:16.544955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e09eed-643a-464b-8b0e-8f52504569be None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:16.550283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:16.676693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e09eed-643a-464b-8b0e-8f52504569be None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:16.717347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501fb6b-27b8-4cf6-853c-affa7a881243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:16.718572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501fb6b-27b8-4cf6-853c-affa7a881243 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.718862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501fb6b-27b8-4cf6-853c-affa7a881243 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.719135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501fb6b-27b8-4cf6-853c-affa7a881243 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.719924 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501fb6b-27b8-4cf6-853c-affa7a881243 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:16.720234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501fb6b-27b8-4cf6-853c-affa7a881243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:16.721622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501fb6b-27b8-4cf6-853c-affa7a881243 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:16.732611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 136/283] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:16 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:16.740846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696df793-4a19-4783-b62d-b3034bde4869 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:16.799964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d96a-48c7-4782-b7a7-9411ff771cae None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.800303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d96a-48c7-4782-b7a7-9411ff771cae None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.800575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0d96a-48c7-4782-b7a7-9411ff771cae None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.801964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 137/284] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:13:16.809156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadde2c-de25-4819-991e-ca4b5d92db3f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.809440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadde2c-de25-4819-991e-ca4b5d92db3f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.809717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadde2c-de25-4819-991e-ca4b5d92db3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.833403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-caadde2c-de25-4819-991e-ca4b5d92db3f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:16.834609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-caadde2c-de25-4819-991e-ca4b5d92db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:16.892962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696df793-4a19-4783-b62d-b3034bde4869 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:16.895874 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:16.945580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1b42d-84ec-4554-b1ae-e93451e84bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:16.946384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1b42d-84ec-4554-b1ae-e93451e84bbe None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:16.946667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1b42d-84ec-4554-b1ae-e93451e84bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:16.946943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1b42d-84ec-4554-b1ae-e93451e84bbe None admin] PATH_INFO: `/v3/users/2bcad56ce79640079bda31eb1b5d9ad3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:16.949438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1b42d-84ec-4554-b1ae-e93451e84bbe None admin] RBAC: Authorizing `identity:get_user(user_id=2bcad56ce79640079bda31eb1b5d9ad3)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:16.950928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1b42d-84ec-4554-b1ae-e93451e84bbe None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:16.954371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 148/285] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:16 2022] GET /identity/v3/users/2bcad56ce79640079bda31eb1b5d9ad3 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:16.961165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1b42d-84ec-4554-b1ae-e93451e84bbe None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:16.983538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:16.987401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 138/286] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:17.013818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadde2c-de25-4819-991e-ca4b5d92db3f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:17.129336 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadde2c-de25-4819-991e-ca4b5d92db3f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:17.147167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1b42d-84ec-4554-b1ae-e93451e84bbe None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:17.201396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fb1d9-18af-4d36-9c8c-5aaecda6a9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:17.202111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fb1d9-18af-4d36-9c8c-5aaecda6a9bf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:17.202912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fb1d9-18af-4d36-9c8c-5aaecda6a9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:17.203188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fb1d9-18af-4d36-9c8c-5aaecda6a9bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:17.220959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50babb-6dc7-440f-9e4e-eb78dab6dc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:17.221834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50babb-6dc7-440f-9e4e-eb78dab6dc53 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:17.222112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50babb-6dc7-440f-9e4e-eb78dab6dc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:17.222385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50babb-6dc7-440f-9e4e-eb78dab6dc53 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:17.224365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50babb-6dc7-440f-9e4e-eb78dab6dc53 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:17.225849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50babb-6dc7-440f-9e4e-eb78dab6dc53 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:17.227593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 149/287] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:16 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:17.230687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fb1d9-18af-4d36-9c8c-5aaecda6a9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:17.236628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50babb-6dc7-440f-9e4e-eb78dab6dc53 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-988fb1d9-18af-4d36-9c8c-5aaecda6a9bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:17.239115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:17.240054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:17.240867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 139/288] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:17.246793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fb1d9-18af-4d36-9c8c-5aaecda6a9bf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:17.282422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:17.339930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:17.388397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fb1d9-18af-4d36-9c8c-5aaecda6a9bf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:17.429074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b980db-6abe-46fc-881a-aed178ebfdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:17.429736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b980db-6abe-46fc-881a-aed178ebfdbb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:17.430019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b980db-6abe-46fc-881a-aed178ebfdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:17.430509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b980db-6abe-46fc-881a-aed178ebfdbb None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:17.431872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b980db-6abe-46fc-881a-aed178ebfdbb None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:17.432212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b980db-6abe-46fc-881a-aed178ebfdbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:17.433624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b980db-6abe-46fc-881a-aed178ebfdbb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:17.443565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 140/289] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:17.450098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b980db-6abe-46fc-881a-aed178ebfdbb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:17.557772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50babb-6dc7-440f-9e4e-eb78dab6dc53 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:17.566421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b980db-6abe-46fc-881a-aed178ebfdbb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:17.597506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:17.605903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd969e4-0911-43d3-ac7b-8a32514f370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:17.606795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd969e4-0911-43d3-ac7b-8a32514f370f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:17.607345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd969e4-0911-43d3-ac7b-8a32514f370f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:17.607682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd969e4-0911-43d3-ac7b-8a32514f370f None admin] PATH_INFO: `/v3/users/ce243c8ac90240c182a8c18edefd762d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:17.609577 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd969e4-0911-43d3-ac7b-8a32514f370f None admin] RBAC: Authorizing `identity:get_user(user_id=ce243c8ac90240c182a8c18edefd762d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:17.611053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd969e4-0911-43d3-ac7b-8a32514f370f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:17.613228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 141/290] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:17 2022] GET /identity/v3/users/ce243c8ac90240c182a8c18edefd762d => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:17.618691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd969e4-0911-43d3-ac7b-8a32514f370f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:17.700320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562febdc-920f-492a-afa9-2473861dd01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:17.701253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562febdc-920f-492a-afa9-2473861dd01d None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:17.701541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562febdc-920f-492a-afa9-2473861dd01d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:17.701819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562febdc-920f-492a-afa9-2473861dd01d None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/users/2bcad56ce79640079bda31eb1b5d9ad3/roles/a1bdbf0d655e48afb678e720ec7d1d7a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:17.712526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562febdc-920f-492a-afa9-2473861dd01d None admin] RBAC: Authorizing `identity:create_grant(project_id=cda8b9fce6604ccbaa4b14c8377676ca, user_id=2bcad56ce79640079bda31eb1b5d9ad3, role_id=a1bdbf0d655e48afb678e720ec7d1d7a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:17.714032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562febdc-920f-492a-afa9-2473861dd01d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:17.740217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 150/291] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:13:17 2022] PUT /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/users/2bcad56ce79640079bda31eb1b5d9ad3/roles/a1bdbf0d655e48afb678e720ec7d1d7a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:13:17.744915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd969e4-0911-43d3-ac7b-8a32514f370f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:17.785546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872ef76-0430-403d-a633-20b128869132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:17.786209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872ef76-0430-403d-a633-20b128869132 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:17.786489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872ef76-0430-403d-a633-20b128869132 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:17.786758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872ef76-0430-403d-a633-20b128869132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:17.846479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:17.865190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872ef76-0430-403d-a633-20b128869132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:17.866698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872ef76-0430-403d-a633-20b128869132 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:17.986644 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 142/292] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:17.992287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562febdc-920f-492a-afa9-2473861dd01d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:18.077479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:18.101321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562febdc-920f-492a-afa9-2473861dd01d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:18.138142 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92537e52-aa99-4fbf-8315-5494079a9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:18.139009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537e52-aa99-4fbf-8315-5494079a9b35 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:18.139288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537e52-aa99-4fbf-8315-5494079a9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:18.139577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537e52-aa99-4fbf-8315-5494079a9b35 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:18.140848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92537e52-aa99-4fbf-8315-5494079a9b35 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:18.142314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92537e52-aa99-4fbf-8315-5494079a9b35 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:18.144085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 151/293] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:17 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:18.150143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872ef76-0430-403d-a633-20b128869132 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:18.245658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:18.262916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872ef76-0430-403d-a633-20b128869132 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:18.307534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86509-686c-4820-b361-dd72f4e46677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:18.308221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86509-686c-4820-b361-dd72f4e46677 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:18.308504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86509-686c-4820-b361-dd72f4e46677 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:18.308778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86509-686c-4820-b361-dd72f4e46677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:18.309683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd86509-686c-4820-b361-dd72f4e46677 None admin] RBAC: Adding query filter params (role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca, user.id=ce243c8ac90240c182a8c18edefd762d) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:18.309997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd86509-686c-4820-b361-dd72f4e46677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:18.311530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd86509-686c-4820-b361-dd72f4e46677 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:18.318973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 143/294] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:18 2022] GET /identity/v3/role_assignments?user.id=ce243c8ac90240c182a8c18edefd762d&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 610 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:19.015838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba49d-1064-49e8-98f4-7d562dc2ffc7 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.016360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba49d-1064-49e8-98f4-7d562dc2ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.016437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba49d-1064-49e8-98f4-7d562dc2ffc7 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.017997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 152/295] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:19.023502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379db03-91a6-4158-8610-3ff08b0bfac1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.023942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379db03-91a6-4158-8610-3ff08b0bfac1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.024115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379db03-91a6-4158-8610-3ff08b0bfac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.042475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2379db03-91a6-4158-8610-3ff08b0bfac1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:19.043710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2379db03-91a6-4158-8610-3ff08b0bfac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:19.095714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2788f3-726d-4026-83c7-54c372c248c1 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.096037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2788f3-726d-4026-83c7-54c372c248c1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.096280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2788f3-726d-4026-83c7-54c372c248c1 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.097959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 153/296] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:19.103038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca8629-9f8b-445a-99b0-db8aabbdd3e6 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.103331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca8629-9f8b-445a-99b0-db8aabbdd3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.103638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca8629-9f8b-445a-99b0-db8aabbdd3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.114435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 144/297] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:19.121578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8dca8629-9f8b-445a-99b0-db8aabbdd3e6 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:19.122777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8dca8629-9f8b-445a-99b0-db8aabbdd3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:19.137665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379db03-91a6-4158-8610-3ff08b0bfac1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:19.205192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 154/298] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:19.206838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978181f-844f-419f-bbf9-260217e6b3a1 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.207129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978181f-844f-419f-bbf9-260217e6b3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.207409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978181f-844f-419f-bbf9-260217e6b3a1 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.208846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 155/299] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:19.213913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f02b9f-76f4-47a0-87cc-9ec4aa31eb1d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.214204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f02b9f-76f4-47a0-87cc-9ec4aa31eb1d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.214486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f02b9f-76f4-47a0-87cc-9ec4aa31eb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.238122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-37f02b9f-76f4-47a0-87cc-9ec4aa31eb1d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:19.239757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-37f02b9f-76f4-47a0-87cc-9ec4aa31eb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:19.240239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:19.264485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379db03-91a6-4158-8610-3ff08b0bfac1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:19.304148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c805-a63a-47e5-84e9-d51aa6eed8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:19.304828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c805-a63a-47e5-84e9-d51aa6eed8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.305116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c805-a63a-47e5-84e9-d51aa6eed8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.305496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c805-a63a-47e5-84e9-d51aa6eed8f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.317814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036c805-a63a-47e5-84e9-d51aa6eed8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:19.327839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 156/300] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:19.327839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f02b9f-76f4-47a0-87cc-9ec4aa31eb1d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5036c805-a63a-47e5-84e9-d51aa6eed8f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:19.328155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:19.328990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:19.329852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 145/301] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:13:19.332187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:19.333603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c805-a63a-47e5-84e9-d51aa6eed8f6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:19.443688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c805-a63a-47e5-84e9-d51aa6eed8f6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:19.444037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f02b9f-76f4-47a0-87cc-9ec4aa31eb1d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:19.479743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33803ddc-671c-48fc-8418-defc96ca41bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:19.480541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33803ddc-671c-48fc-8418-defc96ca41bd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.480824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33803ddc-671c-48fc-8418-defc96ca41bd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.481101 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33803ddc-671c-48fc-8418-defc96ca41bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.483295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1e95d-c189-45f6-84ad-f65cc2dfaf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:19.484595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e95d-c189-45f6-84ad-f65cc2dfaf3d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.484865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e95d-c189-45f6-84ad-f65cc2dfaf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.485146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1e95d-c189-45f6-84ad-f65cc2dfaf3d None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.485892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1e95d-c189-45f6-84ad-f65cc2dfaf3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:19.486201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1e95d-c189-45f6-84ad-f65cc2dfaf3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:19.487657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1e95d-c189-45f6-84ad-f65cc2dfaf3d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:19.492793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33803ddc-671c-48fc-8418-defc96ca41bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:19.493810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-33803ddc-671c-48fc-8418-defc96ca41bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:19.501307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:19.502228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:19.503041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:19.504329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 146/302] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:19 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:19.504329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1e95d-c189-45f6-84ad-f65cc2dfaf3d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:19.507172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 157/303] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:19.508346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33803ddc-671c-48fc-8418-defc96ca41bd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:19.575723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:19.610804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1e95d-c189-45f6-84ad-f65cc2dfaf3d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:19.619427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33803ddc-671c-48fc-8418-defc96ca41bd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:19.646387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08465988-d5fa-44e4-a511-974273b9290d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:19.647572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08465988-d5fa-44e4-a511-974273b9290d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.647944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08465988-d5fa-44e4-a511-974273b9290d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.648226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08465988-d5fa-44e4-a511-974273b9290d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.650392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08465988-d5fa-44e4-a511-974273b9290d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:19.651900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08465988-d5fa-44e4-a511-974273b9290d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:19.658841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 147/304] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:19 2022] GET /identity/v3/domains/default => generated 200 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:19.659530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08465988-d5fa-44e4-a511-974273b9290d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:19.659902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdcb22-09c4-4cba-832c-53c5e5d92d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:19.660758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdcb22-09c4-4cba-832c-53c5e5d92d6a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.661044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdcb22-09c4-4cba-832c-53c5e5d92d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.661321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdcb22-09c4-4cba-832c-53c5e5d92d6a None admin] PATH_INFO: `/v3/users/4639cc99b6344e0687e355d934cec591` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.662720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdcb22-09c4-4cba-832c-53c5e5d92d6a None admin] RBAC: Authorizing `identity:get_user(user_id=4639cc99b6344e0687e355d934cec591)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:19.665048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdcb22-09c4-4cba-832c-53c5e5d92d6a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:19.666796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 158/305] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:19 2022] GET /identity/v3/users/4639cc99b6344e0687e355d934cec591 => generated 294 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:19.668360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdcb22-09c4-4cba-832c-53c5e5d92d6a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:19.733394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:19.769753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08465988-d5fa-44e4-a511-974273b9290d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:19.778388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdcb22-09c4-4cba-832c-53c5e5d92d6a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:19.806314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0e37e-9cbd-47ce-9fe7-5dd5fdda679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:19.807027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0e37e-9cbd-47ce-9fe7-5dd5fdda679f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.807297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0e37e-9cbd-47ce-9fe7-5dd5fdda679f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.807530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0e37e-9cbd-47ce-9fe7-5dd5fdda679f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.808414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0e37e-9cbd-47ce-9fe7-5dd5fdda679f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:19.808617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0e37e-9cbd-47ce-9fe7-5dd5fdda679f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:19.809983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0e37e-9cbd-47ce-9fe7-5dd5fdda679f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:19.811415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:19.816466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0b04-a6f0-4867-b533-4afc64015528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:19.817056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0b04-a6f0-4867-b533-4afc64015528 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:19.817692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0b04-a6f0-4867-b533-4afc64015528 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:19.817975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e0b04-a6f0-4867-b533-4afc64015528 None admin] PATH_INFO: `/v3/groups` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:19.818809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 148/306] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:19 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:19.818938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e0b04-a6f0-4867-b533-4afc64015528 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:19.820154 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e0b04-a6f0-4867-b533-4afc64015528 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:19.820658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0e37e-9cbd-47ce-9fe7-5dd5fdda679f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:19.835990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 159/307] 10.222.0.112 () {60 vars in 1139 bytes} [Fri Jun 3 16:13:19 2022] POST /identity/v3/groups => generated 230 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:13:19.836748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0b04-a6f0-4867-b533-4afc64015528 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:19.963927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e0b04-a6f0-4867-b533-4afc64015528 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:19.977258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0e37e-9cbd-47ce-9fe7-5dd5fdda679f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:20.005519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c3f5-2d5b-4dc5-ad18-690f6b866283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:20.006426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c3f5-2d5b-4dc5-ad18-690f6b866283 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:20.006709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c3f5-2d5b-4dc5-ad18-690f6b866283 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:20.006985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088c3f5-2d5b-4dc5-ad18-690f6b866283 None admin] PATH_INFO: `/v3/users/3be196c23ac44331b6e6035129cedbad` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:20.022659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:20.029067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c3f5-2d5b-4dc5-ad18-690f6b866283 None admin] RBAC: Authorizing `identity:get_user(user_id=3be196c23ac44331b6e6035129cedbad)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:20.031273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088c3f5-2d5b-4dc5-ad18-690f6b866283 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:20.033131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 160/308] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:19 2022] GET /identity/v3/users/3be196c23ac44331b6e6035129cedbad => generated 294 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:20.034025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcbc27-c655-44ed-8ad3-f3169b2a0e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:20.035487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcbc27-c655-44ed-8ad3-f3169b2a0e8c None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:20.036009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcbc27-c655-44ed-8ad3-f3169b2a0e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:20.036485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcbc27-c655-44ed-8ad3-f3169b2a0e8c None admin] PATH_INFO: `/v3/system/users/4639cc99b6344e0687e355d934cec591/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:20.038337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcbc27-c655-44ed-8ad3-f3169b2a0e8c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4639cc99b6344e0687e355d934cec591, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:20.038974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c3f5-2d5b-4dc5-ad18-690f6b866283 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:20.040461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcbc27-c655-44ed-8ad3-f3169b2a0e8c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:20.059582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 149/309] 10.222.0.112 () {58 vars in 1339 bytes} [Fri Jun 3 16:13:19 2022] PUT /identity/v3/system/users/4639cc99b6344e0687e355d934cec591/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:13:20.116977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:20.181477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088c3f5-2d5b-4dc5-ad18-690f6b866283 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:20.221831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59514ea-ec5d-4694-ab51-ae9bb02c74e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:20.222559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59514ea-ec5d-4694-ab51-ae9bb02c74e9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:20.222848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59514ea-ec5d-4694-ab51-ae9bb02c74e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:20.223132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59514ea-ec5d-4694-ab51-ae9bb02c74e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:20.224098 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59514ea-ec5d-4694-ab51-ae9bb02c74e9 None admin] RBAC: Adding query filter params (role.id=a1bdbf0d655e48afb678e720ec7d1d7a, user.id=3be196c23ac44331b6e6035129cedbad, scope.system=all) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:20.224418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59514ea-ec5d-4694-ab51-ae9bb02c74e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:20.225919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59514ea-ec5d-4694-ab51-ae9bb02c74e9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:20.232680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 161/310] 10.222.0.112 () {56 vars in 1313 bytes} [Fri Jun 3 16:13:20 2022] GET /identity/v3/role_assignments?user.id=3be196c23ac44331b6e6035129cedbad&scope.system=all&role.id=a1bdbf0d655e48afb678e720ec7d1d7a => generated 227 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:20.447339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1644b-8dba-4997-a956-a065915024d7 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:20.447755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1644b-8dba-4997-a956-a065915024d7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:20.447937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1644b-8dba-4997-a956-a065915024d7 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:20.449479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 150/311] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:20.455297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91376eb2-8340-4958-86d3-7410a2f630ee None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:20.455609 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91376eb2-8340-4958-86d3-7410a2f630ee None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:20.455891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91376eb2-8340-4958-86d3-7410a2f630ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:20.476416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-91376eb2-8340-4958-86d3-7410a2f630ee None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:20.477605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-91376eb2-8340-4958-86d3-7410a2f630ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:20.547250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 162/312] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:20.570842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1644b-8dba-4997-a956-a065915024d7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:20.681956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1644b-8dba-4997-a956-a065915024d7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:20.718760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb176a74-342a-43bf-870c-e883a9a9f73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:20.719539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176a74-342a-43bf-870c-e883a9a9f73e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:20.719851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176a74-342a-43bf-870c-e883a9a9f73e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:20.720164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb176a74-342a-43bf-870c-e883a9a9f73e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:20.731537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb176a74-342a-43bf-870c-e883a9a9f73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-eb176a74-342a-43bf-870c-e883a9a9f73e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:20.739787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:20.740684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:20.741496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 151/313] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:20.748079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91376eb2-8340-4958-86d3-7410a2f630ee None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:20.798848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:20.855667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91376eb2-8340-4958-86d3-7410a2f630ee None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:20.891289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4319-49a3-4831-9abb-3ddb4b640a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:20.891990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4319-49a3-4831-9abb-3ddb4b640a05 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:20.892275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4319-49a3-4831-9abb-3ddb4b640a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:20.892555 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4319-49a3-4831-9abb-3ddb4b640a05 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:20.893305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce4319-49a3-4831-9abb-3ddb4b640a05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:20.893612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce4319-49a3-4831-9abb-3ddb4b640a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:20.894999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce4319-49a3-4831-9abb-3ddb4b640a05 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:20.903658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 163/314] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:20 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:20.909546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb176a74-342a-43bf-870c-e883a9a9f73e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:20.968735 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:21.017884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb176a74-342a-43bf-870c-e883a9a9f73e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:21.052898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800025-1f99-4799-80c3-a2cb85e84142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:21.053771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800025-1f99-4799-80c3-a2cb85e84142 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:21.054051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800025-1f99-4799-80c3-a2cb85e84142 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:21.054334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800025-1f99-4799-80c3-a2cb85e84142 None admin] PATH_INFO: `/v3/users/2bcad56ce79640079bda31eb1b5d9ad3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:21.055536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16800025-1f99-4799-80c3-a2cb85e84142 None admin] RBAC: Authorizing `identity:get_user(user_id=2bcad56ce79640079bda31eb1b5d9ad3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:21.057028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16800025-1f99-4799-80c3-a2cb85e84142 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:21.058963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 152/315] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:20 2022] GET /identity/v3/users/2bcad56ce79640079bda31eb1b5d9ad3 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:21.065021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4319-49a3-4831-9abb-3ddb4b640a05 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:21.179131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4319-49a3-4831-9abb-3ddb4b640a05 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:21.188982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:21.214112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091930f-5eea-49ae-aedf-5c24b440ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:21.214760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091930f-5eea-49ae-aedf-5c24b440ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:21.215044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091930f-5eea-49ae-aedf-5c24b440ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:21.215322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091930f-5eea-49ae-aedf-5c24b440ffa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:21.290002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091930f-5eea-49ae-aedf-5c24b440ffa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:21.291419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091930f-5eea-49ae-aedf-5c24b440ffa6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:21.399605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 164/316] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:21.411676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800025-1f99-4799-80c3-a2cb85e84142 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:21.520665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800025-1f99-4799-80c3-a2cb85e84142 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:21.548146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:21.558572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d193f-ab98-4ea0-83da-338359ba7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:21.559433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d193f-ab98-4ea0-83da-338359ba7295 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:21.559742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d193f-ab98-4ea0-83da-338359ba7295 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:21.560015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d193f-ab98-4ea0-83da-338359ba7295 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:21.561203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d193f-ab98-4ea0-83da-338359ba7295 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:21.562730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d193f-ab98-4ea0-83da-338359ba7295 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:21.564642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 153/317] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:21 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:21.570486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091930f-5eea-49ae-aedf-5c24b440ffa6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:21.579233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:21.673280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091930f-5eea-49ae-aedf-5c24b440ffa6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:21.708474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeb9b1-f66f-4089-9dd6-3e44066de395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:21.709134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb9b1-f66f-4089-9dd6-3e44066de395 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:21.709418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb9b1-f66f-4089-9dd6-3e44066de395 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:21.709694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeb9b1-f66f-4089-9dd6-3e44066de395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:21.710536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb9b1-f66f-4089-9dd6-3e44066de395 None admin] RBAC: Adding query filter params (role.id=a1bdbf0d655e48afb678e720ec7d1d7a, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca, user.id=2bcad56ce79640079bda31eb1b5d9ad3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:21.710850 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb9b1-f66f-4089-9dd6-3e44066de395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:21.712330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeb9b1-f66f-4089-9dd6-3e44066de395 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:21.718716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 165/318] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:21 2022] GET /identity/v3/role_assignments?user.id=2bcad56ce79640079bda31eb1b5d9ad3&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=a1bdbf0d655e48afb678e720ec7d1d7a => generated 610 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:22.369658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275e5e-7438-4c95-9ef5-ff83f9bef1be None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.370395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275e5e-7438-4c95-9ef5-ff83f9bef1be None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.370395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275e5e-7438-4c95-9ef5-ff83f9bef1be None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:22.372231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 154/319] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:13:22.378197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d597c3f-feed-42d5-92a8-4d960ae427d4 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.378777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d597c3f-feed-42d5-92a8-4d960ae427d4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.378777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d597c3f-feed-42d5-92a8-4d960ae427d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:22.396579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8d597c3f-feed-42d5-92a8-4d960ae427d4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:22.397785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8d597c3f-feed-42d5-92a8-4d960ae427d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:22.467011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:22.473981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 166/320] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:22.490938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea887e7-7068-4a1e-9f33-0cc4fd9564f6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.491233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea887e7-7068-4a1e-9f33-0cc4fd9564f6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.491518 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea887e7-7068-4a1e-9f33-0cc4fd9564f6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:22.493091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 155/321] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:13:22.496469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d597c3f-feed-42d5-92a8-4d960ae427d4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:22.498162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6fa3-36a9-4134-b519-e4ef4193264d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.498524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6fa3-36a9-4134-b519-e4ef4193264d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.498889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6fa3-36a9-4134-b519-e4ef4193264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:22.516786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-beff6fa3-36a9-4134-b519-e4ef4193264d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:22.518055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-beff6fa3-36a9-4134-b519-e4ef4193264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:22.597181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 156/322] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:22.598533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318895-6275-47ef-9fa9-6462afd8b6a9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.598820 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318895-6275-47ef-9fa9-6462afd8b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.599098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca318895-6275-47ef-9fa9-6462afd8b6a9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:22.600436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 157/323] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:22.606345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d597c3f-feed-42d5-92a8-4d960ae427d4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:22.610851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79950-6dc9-44fb-8903-0d6fe9ceb4b4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.611136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79950-6dc9-44fb-8903-0d6fe9ceb4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.611413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c79950-6dc9-44fb-8903-0d6fe9ceb4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:22.628743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-47c79950-6dc9-44fb-8903-0d6fe9ceb4b4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:22.629915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-47c79950-6dc9-44fb-8903-0d6fe9ceb4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:22.643418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf56eb7-b914-4e20-bd88-a4ba3a156951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:22.644240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf56eb7-b914-4e20-bd88-a4ba3a156951 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.644519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf56eb7-b914-4e20-bd88-a4ba3a156951 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.644790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf56eb7-b914-4e20-bd88-a4ba3a156951 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:22.645951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf56eb7-b914-4e20-bd88-a4ba3a156951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:22.647396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf56eb7-b914-4e20-bd88-a4ba3a156951 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:22.649046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 167/324] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:22 2022] GET /identity/v3/domains/default => generated 200 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:22.654560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf56eb7-b914-4e20-bd88-a4ba3a156951 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:22.696269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 158/325] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:22.707793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c79950-6dc9-44fb-8903-0d6fe9ceb4b4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:22.723712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:22.747596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:22.759478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf56eb7-b914-4e20-bd88-a4ba3a156951 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:22.793441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951edd9-8bee-454d-9ac5-040055d7dc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:22.794227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951edd9-8bee-454d-9ac5-040055d7dc66 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.794504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951edd9-8bee-454d-9ac5-040055d7dc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.794773 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951edd9-8bee-454d-9ac5-040055d7dc66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:22.797969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c79950-6dc9-44fb-8903-0d6fe9ceb4b4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:22.806154 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951edd9-8bee-454d-9ac5-040055d7dc66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-a951edd9-8bee-454d-9ac5-040055d7dc66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:22.814328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:22.816007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 168/326] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:22.817560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951edd9-8bee-454d-9ac5-040055d7dc66 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:22.838645 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122f2b9-1d2d-4a48-acf9-2bd34e3ddd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:22.839312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122f2b9-1d2d-4a48-acf9-2bd34e3ddd8d None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.839625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122f2b9-1d2d-4a48-acf9-2bd34e3ddd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.839901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122f2b9-1d2d-4a48-acf9-2bd34e3ddd8d None admin] PATH_INFO: `/v3/groups` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:22.840601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122f2b9-1d2d-4a48-acf9-2bd34e3ddd8d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:22.842182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122f2b9-1d2d-4a48-acf9-2bd34e3ddd8d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:22.859163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 159/327] 10.222.0.112 () {60 vars in 1139 bytes} [Fri Jun 3 16:13:22 2022] POST /identity/v3/groups => generated 227 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:13:22.860029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122f2b9-1d2d-4a48-acf9-2bd34e3ddd8d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:22.943465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951edd9-8bee-454d-9ac5-040055d7dc66 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:22.978792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:22.989789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf403cb-5ade-40e7-bf9e-c9f94f536429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:22.990164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122f2b9-1d2d-4a48-acf9-2bd34e3ddd8d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:22.990606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf403cb-5ade-40e7-bf9e-c9f94f536429 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:22.990890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf403cb-5ade-40e7-bf9e-c9f94f536429 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:22.991163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf403cb-5ade-40e7-bf9e-c9f94f536429 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:23.003032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:23.004360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf403cb-5ade-40e7-bf9e-c9f94f536429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-bcf403cb-5ade-40e7-bf9e-c9f94f536429 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:23.013063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:23.014062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:23.015437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 169/328] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:23.021147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf403cb-5ade-40e7-bf9e-c9f94f536429 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:23.042714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd2dc4-d938-4b19-95b6-88fc7d1e1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:23.043298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd2dc4-d938-4b19-95b6-88fc7d1e1d7e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:23.043609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd2dc4-d938-4b19-95b6-88fc7d1e1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:23.043890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd2dc4-d938-4b19-95b6-88fc7d1e1d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:23.044662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd2dc4-d938-4b19-95b6-88fc7d1e1d7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:23.044966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd2dc4-d938-4b19-95b6-88fc7d1e1d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:23.046610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd2dc4-d938-4b19-95b6-88fc7d1e1d7e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:23.058630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 160/329] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:23.063068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd2dc4-d938-4b19-95b6-88fc7d1e1d7e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:23.155660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf403cb-5ade-40e7-bf9e-c9f94f536429 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:23.196013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd2dc4-d938-4b19-95b6-88fc7d1e1d7e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:23.208009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3dc90-1b92-4dc6-aeab-0c3d318a9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:23.209037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3dc90-1b92-4dc6-aeab-0c3d318a9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:23.209322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3dc90-1b92-4dc6-aeab-0c3d318a9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:23.210030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3dc90-1b92-4dc6-aeab-0c3d318a9ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:23.210370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3dc90-1b92-4dc6-aeab-0c3d318a9ae2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:23.210681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3dc90-1b92-4dc6-aeab-0c3d318a9ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:23.212197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3dc90-1b92-4dc6-aeab-0c3d318a9ae2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:23.222549 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 170/330] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:23 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:23.231657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3dc90-1b92-4dc6-aeab-0c3d318a9ae2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:23.247781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924cac-a5d7-4044-beee-4893148e89de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:23.249638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924cac-a5d7-4044-beee-4893148e89de None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:23.249923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924cac-a5d7-4044-beee-4893148e89de None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:23.250196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924cac-a5d7-4044-beee-4893148e89de None admin] PATH_INFO: `/v3/users/4639cc99b6344e0687e355d934cec591` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:23.251676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924cac-a5d7-4044-beee-4893148e89de None admin] RBAC: Authorizing `identity:get_user(user_id=4639cc99b6344e0687e355d934cec591)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:23.253137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d924cac-a5d7-4044-beee-4893148e89de None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:23.254794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 161/331] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:23 2022] GET /identity/v3/users/4639cc99b6344e0687e355d934cec591 => generated 294 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:23.261223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924cac-a5d7-4044-beee-4893148e89de None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:23.307650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:23.317716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:23.375062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3dc90-1b92-4dc6-aeab-0c3d318a9ae2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:23.392427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924cac-a5d7-4044-beee-4893148e89de None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:23.429354 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983c5a-2572-4add-9223-82d14eb6cf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:23.430232 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983c5a-2572-4add-9223-82d14eb6cf53 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:23.430514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983c5a-2572-4add-9223-82d14eb6cf53 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:23.430787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983c5a-2572-4add-9223-82d14eb6cf53 None admin] PATH_INFO: `/v3/users/3be196c23ac44331b6e6035129cedbad` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:23.432865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c983c5a-2572-4add-9223-82d14eb6cf53 None admin] RBAC: Authorizing `identity:get_user(user_id=3be196c23ac44331b6e6035129cedbad)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:23.435164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c983c5a-2572-4add-9223-82d14eb6cf53 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:23.438550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 171/332] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:23 2022] GET /identity/v3/users/3be196c23ac44331b6e6035129cedbad => generated 294 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:23.443785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0d67-1028-4c20-a07c-1e3c57fda77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:23.444480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983c5a-2572-4add-9223-82d14eb6cf53 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:23.444609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0d67-1028-4c20-a07c-1e3c57fda77b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:23.444773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0d67-1028-4c20-a07c-1e3c57fda77b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:23.445046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0d67-1028-4c20-a07c-1e3c57fda77b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:23.445928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec0d67-1028-4c20-a07c-1e3c57fda77b None admin] RBAC: Adding query filter params (role.id=0048b2f4edbf4a69a99a3d1225c90e18, user.id=4639cc99b6344e0687e355d934cec591, scope.system=all) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:23.446251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec0d67-1028-4c20-a07c-1e3c57fda77b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:23.447992 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec0d67-1028-4c20-a07c-1e3c57fda77b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:23.465204 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 162/333] 10.222.0.112 () {56 vars in 1313 bytes} [Fri Jun 3 16:13:23 2022] GET /identity/v3/role_assignments?user.id=4639cc99b6344e0687e355d934cec591&scope.system=all&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 512 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:23.593496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983c5a-2572-4add-9223-82d14eb6cf53 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:23.614701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:23.644138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83048852-8b83-451a-ada5-e49209ad9619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:23.645155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83048852-8b83-451a-ada5-e49209ad9619 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:23.645532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83048852-8b83-451a-ada5-e49209ad9619 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:23.645812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83048852-8b83-451a-ada5-e49209ad9619 None admin] PATH_INFO: `/v3/system/users/3be196c23ac44331b6e6035129cedbad/roles/a1bdbf0d655e48afb678e720ec7d1d7a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:23.647585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83048852-8b83-451a-ada5-e49209ad9619 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3be196c23ac44331b6e6035129cedbad, role_id=a1bdbf0d655e48afb678e720ec7d1d7a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:23.649085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83048852-8b83-451a-ada5-e49209ad9619 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:23.661733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 172/334] 10.222.0.112 () {58 vars in 1339 bytes} [Fri Jun 3 16:13:23 2022] PUT /identity/v3/system/users/3be196c23ac44331b6e6035129cedbad/roles/a1bdbf0d655e48afb678e720ec7d1d7a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:13:25.824167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5ebc6-fc80-4d40-92c0-34e0e8e86eff None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:25.825188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5ebc6-fc80-4d40-92c0-34e0e8e86eff None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:25.825694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5ebc6-fc80-4d40-92c0-34e0e8e86eff None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:25.828185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 163/335] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:25.834145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524956-3c21-4ef9-b53f-fbc3e9c004b2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:25.835006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524956-3c21-4ef9-b53f-fbc3e9c004b2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:25.835505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524956-3c21-4ef9-b53f-fbc3e9c004b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:25.860566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-61524956-3c21-4ef9-b53f-fbc3e9c004b2 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:25.862133 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-61524956-3c21-4ef9-b53f-fbc3e9c004b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:25.885946 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a242807-419e-413d-b185-989d3d177d8b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:25.886233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a242807-419e-413d-b185-989d3d177d8b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:25.886704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a242807-419e-413d-b185-989d3d177d8b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:25.888525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 164/336] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:25.894790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f7c62-3a47-4dc1-bd07-574d717162df None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:25.895319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f7c62-3a47-4dc1-bd07-574d717162df None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:25.895821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f7c62-3a47-4dc1-bd07-574d717162df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:25.925193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-781f7c62-3a47-4dc1-bd07-574d717162df None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:25.926987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-781f7c62-3a47-4dc1-bd07-574d717162df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:25.998059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 173/337] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:26.023144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524956-3c21-4ef9-b53f-fbc3e9c004b2 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:26.040044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 165/338] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:26.086456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f7c62-3a47-4dc1-bd07-574d717162df None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:26.128004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:26.179576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524956-3c21-4ef9-b53f-fbc3e9c004b2 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:26.196278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:26.212338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f7c62-3a47-4dc1-bd07-574d717162df None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:26.234187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177a7dd-0b1d-4e05-b923-b5202a4c7ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:26.235003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177a7dd-0b1d-4e05-b923-b5202a4c7ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:26.235281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177a7dd-0b1d-4e05-b923-b5202a4c7ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:26.235581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177a7dd-0b1d-4e05-b923-b5202a4c7ed4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:26.253080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177a7dd-0b1d-4e05-b923-b5202a4c7ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:26.256835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac098284-d08d-48bb-9e00-e14c4efed3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:26.257919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac098284-d08d-48bb-9e00-e14c4efed3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:26.258437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac098284-d08d-48bb-9e00-e14c4efed3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:26.258925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac098284-d08d-48bb-9e00-e14c4efed3d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-6177a7dd-0b1d-4e05-b923-b5202a4c7ed4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:26.264980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:26.265991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:26.266853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 174/339] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:26.272375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177a7dd-0b1d-4e05-b923-b5202a4c7ed4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:26.274794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac098284-d08d-48bb-9e00-e14c4efed3d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ac098284-d08d-48bb-9e00-e14c4efed3d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:26.291263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:26.295324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:26.297032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:26.299055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 166/340] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:13:26.306695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac098284-d08d-48bb-9e00-e14c4efed3d7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:26.391701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177a7dd-0b1d-4e05-b923-b5202a4c7ed4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:26.431589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dff335-b932-45e9-9bfa-5ae6f119426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:26.431589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dff335-b932-45e9-9bfa-5ae6f119426e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:26.431589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dff335-b932-45e9-9bfa-5ae6f119426e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:26.431589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dff335-b932-45e9-9bfa-5ae6f119426e None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:26.432050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dff335-b932-45e9-9bfa-5ae6f119426e None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:26.432050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dff335-b932-45e9-9bfa-5ae6f119426e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:26.433127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dff335-b932-45e9-9bfa-5ae6f119426e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:26.447967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 175/341] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:26.449029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dff335-b932-45e9-9bfa-5ae6f119426e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:26.458281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:26.462708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac098284-d08d-48bb-9e00-e14c4efed3d7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:26.487656 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:26.514846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405a587-1aad-402d-ba1d-0168152db788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:26.515851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405a587-1aad-402d-ba1d-0168152db788 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:26.516317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405a587-1aad-402d-ba1d-0168152db788 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:26.516737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405a587-1aad-402d-ba1d-0168152db788 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:26.517656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405a587-1aad-402d-ba1d-0168152db788 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:26.518122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405a587-1aad-402d-ba1d-0168152db788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:26.519961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405a587-1aad-402d-ba1d-0168152db788 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:26.529668 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 167/342] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:26.534632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117398-da95-422c-b4ec-d54ce10bd36b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:26.535181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117398-da95-422c-b4ec-d54ce10bd36b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:26.535667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117398-da95-422c-b4ec-d54ce10bd36b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:26.537555 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 168/343] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:26.538568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8117398-da95-422c-b4ec-d54ce10bd36b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:26.589131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dff335-b932-45e9-9bfa-5ae6f119426e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:26.649399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18a804-5477-4e80-a02c-3fb0ace4f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:26.649984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18a804-5477-4e80-a02c-3fb0ace4f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:26.650319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18a804-5477-4e80-a02c-3fb0ace4f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:26.650534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18a804-5477-4e80-a02c-3fb0ace4f3f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:26.665417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8117398-da95-422c-b4ec-d54ce10bd36b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:26.704032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0c052-2902-4806-a366-7352303fea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:26.705141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0c052-2902-4806-a366-7352303fea54 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:26.705629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0c052-2902-4806-a366-7352303fea54 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:26.706179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0c052-2902-4806-a366-7352303fea54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:26.728886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18a804-5477-4e80-a02c-3fb0ace4f3f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:26.730440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18a804-5477-4e80-a02c-3fb0ace4f3f8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:26.731912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:26.768920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:26.786455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0c052-2902-4806-a366-7352303fea54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:26.788326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0c052-2902-4806-a366-7352303fea54 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:26.865972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 176/344] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:26.871718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a81ab-c54e-4200-a436-fbfc88eef086 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:26.872041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a81ab-c54e-4200-a436-fbfc88eef086 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:26.872326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a81ab-c54e-4200-a436-fbfc88eef086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:26.891123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5a3a81ab-c54e-4200-a436-fbfc88eef086 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:26.892346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5a3a81ab-c54e-4200-a436-fbfc88eef086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:26.965163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 177/345] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:26.965751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a81ab-c54e-4200-a436-fbfc88eef086 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.013491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 169/346] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:27.015140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0c052-2902-4806-a366-7352303fea54 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.035968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:27.080085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a81ab-c54e-4200-a436-fbfc88eef086 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:27.101558 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:27.129848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b60e7-c8aa-4b9f-8d2f-ae7eb7573ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:27.130752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b60e7-c8aa-4b9f-8d2f-ae7eb7573ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.131038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b60e7-c8aa-4b9f-8d2f-ae7eb7573ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.131323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b60e7-c8aa-4b9f-8d2f-ae7eb7573ec2 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.132705 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b60e7-c8aa-4b9f-8d2f-ae7eb7573ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:27.134237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b60e7-c8aa-4b9f-8d2f-ae7eb7573ec2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:27.137160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 178/347] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:26 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:27.138688 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b60e7-c8aa-4b9f-8d2f-ae7eb7573ec2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.187865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0c052-2902-4806-a366-7352303fea54 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:27.238322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea382e-092b-4e92-84af-0668393085be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:27.239055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea382e-092b-4e92-84af-0668393085be None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.239957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea382e-092b-4e92-84af-0668393085be None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.239957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea382e-092b-4e92-84af-0668393085be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.252463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea382e-092b-4e92-84af-0668393085be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5eea382e-092b-4e92-84af-0668393085be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:27.260442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:27.261479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:27.262378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:27.268072 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 170/348] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:27.269522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11317e-8f88-449c-8fd0-672597aa7ad9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.269818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11317e-8f88-449c-8fd0-672597aa7ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.270086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11317e-8f88-449c-8fd0-672597aa7ad9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.271713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 171/349] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:27.272434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11317e-8f88-449c-8fd0-672597aa7ad9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.314799 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b60e7-c8aa-4b9f-8d2f-ae7eb7573ec2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:27.354845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:27.365335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c86efd-3aea-4aa3-9ec4-c528dce1cbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:27.366212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c86efd-3aea-4aa3-9ec4-c528dce1cbbf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.366491 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c86efd-3aea-4aa3-9ec4-c528dce1cbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.366787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c86efd-3aea-4aa3-9ec4-c528dce1cbbf None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.368118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c86efd-3aea-4aa3-9ec4-c528dce1cbbf None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:27.369696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c86efd-3aea-4aa3-9ec4-c528dce1cbbf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:27.371402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 179/350] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:27 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:27.377486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c86efd-3aea-4aa3-9ec4-c528dce1cbbf None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.414389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11317e-8f88-449c-8fd0-672597aa7ad9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:27.427125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:27.462457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060a09d-3375-4bfc-9c1d-6ec73b99fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:27.463766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060a09d-3375-4bfc-9c1d-6ec73b99fec0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.464383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060a09d-3375-4bfc-9c1d-6ec73b99fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.464724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060a09d-3375-4bfc-9c1d-6ec73b99fec0 None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.471977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060a09d-3375-4bfc-9c1d-6ec73b99fec0 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:27.473539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060a09d-3375-4bfc-9c1d-6ec73b99fec0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:27.479716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 172/351] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:27 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:27.481239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab9cb2-7bff-49d9-b303-d515aed9ca09 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.481680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab9cb2-7bff-49d9-b303-d515aed9ca09 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.482298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab9cb2-7bff-49d9-b303-d515aed9ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.503354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-62ab9cb2-7bff-49d9-b303-d515aed9ca09 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:27.504812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-62ab9cb2-7bff-49d9-b303-d515aed9ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:27.522829 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c86efd-3aea-4aa3-9ec4-c528dce1cbbf None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:27.567248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aa309-cf59-4e08-8458-b08f3f6368f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:27.568720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aa309-cf59-4e08-8458-b08f3f6368f4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.569239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aa309-cf59-4e08-8458-b08f3f6368f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.569835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aa309-cf59-4e08-8458-b08f3f6368f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.571531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aa309-cf59-4e08-8458-b08f3f6368f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:27.572039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aa309-cf59-4e08-8458-b08f3f6368f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:27.574217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3aa309-cf59-4e08-8458-b08f3f6368f4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:27.586759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 173/352] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:27.587115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 180/353] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:27 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:27.587872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab9cb2-7bff-49d9-b303-d515aed9ca09 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.588482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aa309-cf59-4e08-8458-b08f3f6368f4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.684035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:27.716552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab9cb2-7bff-49d9-b303-d515aed9ca09 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:27.728055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:27.733924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aa309-cf59-4e08-8458-b08f3f6368f4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:27.763472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cc61b-8bd3-469b-bd6f-c36632edb60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:27.764285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cc61b-8bd3-469b-bd6f-c36632edb60e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.765123 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cc61b-8bd3-469b-bd6f-c36632edb60e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.765404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cc61b-8bd3-469b-bd6f-c36632edb60e None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.768759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cc61b-8bd3-469b-bd6f-c36632edb60e None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:27.770474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cc61b-8bd3-469b-bd6f-c36632edb60e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:27.772350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 174/354] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:27 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:27.773216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cc61b-8bd3-469b-bd6f-c36632edb60e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.780905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e1797-0ad6-4795-bc77-f82fc42207d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:27.781961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e1797-0ad6-4795-bc77-f82fc42207d1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.782438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e1797-0ad6-4795-bc77-f82fc42207d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.782924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e1797-0ad6-4795-bc77-f82fc42207d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.783804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e1797-0ad6-4795-bc77-f82fc42207d1 None admin] RBAC: Adding query filter params (group.id=4bf5a037ff4a4161aa72821fecb84a38, role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=4148325ec8614e9bbea65c25532b96a0) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:27.784285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e1797-0ad6-4795-bc77-f82fc42207d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:27.785667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e1797-0ad6-4795-bc77-f82fc42207d1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:27.791931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 181/355] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:27 2022] GET /identity/v3/role_assignments?group.id=4bf5a037ff4a4161aa72821fecb84a38&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 261 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:27.792750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e1797-0ad6-4795-bc77-f82fc42207d1 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.894549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cc61b-8bd3-469b-bd6f-c36632edb60e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:27.905580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e1797-0ad6-4795-bc77-f82fc42207d1 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:27.933589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:27.937756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fc0c5-1085-4c7d-8f0c-538b2aaf773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:27.938751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fc0c5-1085-4c7d-8f0c-538b2aaf773c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.939262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fc0c5-1085-4c7d-8f0c-538b2aaf773c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.939767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fc0c5-1085-4c7d-8f0c-538b2aaf773c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.943705 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521244c2-b903-43f3-bc4a-ab9c3f4e634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:27.944580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521244c2-b903-43f3-bc4a-ab9c3f4e634a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.944860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521244c2-b903-43f3-bc4a-ab9c3f4e634a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.945132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521244c2-b903-43f3-bc4a-ab9c3f4e634a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.961580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521244c2-b903-43f3-bc4a-ab9c3f4e634a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-521244c2-b903-43f3-bc4a-ab9c3f4e634a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:27.971820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:27.972786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 16:13:27.973594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:27.975676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 182/356] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:27.977159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b98d8-56fe-4ba6-99a1-725723cc2015 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:27.977443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b98d8-56fe-4ba6-99a1-725723cc2015 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:27.977718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b98d8-56fe-4ba6-99a1-725723cc2015 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:27.979111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 183/357] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:27.982662 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b98d8-56fe-4ba6-99a1-725723cc2015 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:27.995169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:28.031315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fc0c5-1085-4c7d-8f0c-538b2aaf773c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:28.033744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fc0c5-1085-4c7d-8f0c-538b2aaf773c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:28.110560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b98d8-56fe-4ba6-99a1-725723cc2015 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:28.163596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786a486-3a47-4d1a-b7ed-2055226573f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:28.163596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786a486-3a47-4d1a-b7ed-2055226573f8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.163596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786a486-3a47-4d1a-b7ed-2055226573f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.163596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786a486-3a47-4d1a-b7ed-2055226573f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.164006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786a486-3a47-4d1a-b7ed-2055226573f8 None admin] RBAC: Adding query filter params (group.id=4bf5a037ff4a4161aa72821fecb84a38, role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=4148325ec8614e9bbea65c25532b96a0) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:28.164006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786a486-3a47-4d1a-b7ed-2055226573f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:28.164006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786a486-3a47-4d1a-b7ed-2055226573f8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:28.166782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 175/358] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:28.167659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fc0c5-1085-4c7d-8f0c-538b2aaf773c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:28.175863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 184/359] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:27 2022] GET /identity/v3/role_assignments?group.id=4bf5a037ff4a4161aa72821fecb84a38&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 261 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:28.179324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736709e0-8dea-4290-b225-a76b83b637fb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.179324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736709e0-8dea-4290-b225-a76b83b637fb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.179324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736709e0-8dea-4290-b225-a76b83b637fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.201903 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-736709e0-8dea-4290-b225-a76b83b637fb None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:28.203626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-736709e0-8dea-4290-b225-a76b83b637fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:28.254606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:28.268255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:28.288746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fc0c5-1085-4c7d-8f0c-538b2aaf773c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:28.294111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 185/360] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:28.299573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736709e0-8dea-4290-b225-a76b83b637fb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:28.348651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760986-0b5f-41f7-8de2-442d383dd72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:28.349639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760986-0b5f-41f7-8de2-442d383dd72c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.349639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760986-0b5f-41f7-8de2-442d383dd72c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.349934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760986-0b5f-41f7-8de2-442d383dd72c None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.350761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba760986-0b5f-41f7-8de2-442d383dd72c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:28.351058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba760986-0b5f-41f7-8de2-442d383dd72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:28.352599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba760986-0b5f-41f7-8de2-442d383dd72c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:28.366153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 176/361] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:28 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:28.371776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760986-0b5f-41f7-8de2-442d383dd72c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:28.437382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736709e0-8dea-4290-b225-a76b83b637fb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:28.476875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391bd8-b6ca-4d6f-91b4-22d96ae5af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:28.478102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391bd8-b6ca-4d6f-91b4-22d96ae5af1d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.478580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391bd8-b6ca-4d6f-91b4-22d96ae5af1d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.479066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391bd8-b6ca-4d6f-91b4-22d96ae5af1d None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.480678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37391bd8-b6ca-4d6f-91b4-22d96ae5af1d None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:28.482630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37391bd8-b6ca-4d6f-91b4-22d96ae5af1d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:28.485460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760986-0b5f-41f7-8de2-442d383dd72c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:28.485742 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 186/362] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:28 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:28.486737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391bd8-b6ca-4d6f-91b4-22d96ae5af1d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:28.525306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca5d46-5a7d-4549-b1b6-fcd7ed09019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:28.526163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca5d46-5a7d-4549-b1b6-fcd7ed09019b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.526443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca5d46-5a7d-4549-b1b6-fcd7ed09019b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.526768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca5d46-5a7d-4549-b1b6-fcd7ed09019b None admin] PATH_INFO: `/v3/users/3be196c23ac44331b6e6035129cedbad` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.528137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca5d46-5a7d-4549-b1b6-fcd7ed09019b None admin] RBAC: Authorizing `identity:get_user(user_id=3be196c23ac44331b6e6035129cedbad)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:28.529690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca5d46-5a7d-4549-b1b6-fcd7ed09019b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:28.535733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 177/363] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:13:28 2022] GET /identity/v3/users/3be196c23ac44331b6e6035129cedbad => generated 294 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:28.537453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64b67b-7e74-4c18-b9ee-575a3c47e61b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.537742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64b67b-7e74-4c18-b9ee-575a3c47e61b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.538015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64b67b-7e74-4c18-b9ee-575a3c47e61b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.540818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 178/364] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:28.541557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64b67b-7e74-4c18-b9ee-575a3c47e61b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:28.545348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:28.554644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:28.614062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391bd8-b6ca-4d6f-91b4-22d96ae5af1d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:28.650364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea10d1-f1a8-4890-a596-4e8142f1195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:28.651611 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea10d1-f1a8-4890-a596-4e8142f1195f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.652096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea10d1-f1a8-4890-a596-4e8142f1195f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.652583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea10d1-f1a8-4890-a596-4e8142f1195f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.656138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64b67b-7e74-4c18-b9ee-575a3c47e61b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:28.665331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea10d1-f1a8-4890-a596-4e8142f1195f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d8ea10d1-f1a8-4890-a596-4e8142f1195f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:28.674548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:28.675467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:28.676311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:28.678693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 187/365] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:28.680144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fd002-9c4c-4101-9db0-e7b63c016549 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.680713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fd002-9c4c-4101-9db0-e7b63c016549 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.681187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fd002-9c4c-4101-9db0-e7b63c016549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.693090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483547-f019-43df-84e4-1e19656883f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:28.693990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483547-f019-43df-84e4-1e19656883f3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.694323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483547-f019-43df-84e4-1e19656883f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.694592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483547-f019-43df-84e4-1e19656883f3 None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.695998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53483547-f019-43df-84e4-1e19656883f3 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:28.697642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53483547-f019-43df-84e4-1e19656883f3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:28.699329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 179/366] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:28 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:28.703669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483547-f019-43df-84e4-1e19656883f3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:28.706734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f25fd002-9c4c-4101-9db0-e7b63c016549 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:28.708203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f25fd002-9c4c-4101-9db0-e7b63c016549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:28.779733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:28.782801 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 188/367] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:28.784038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fd002-9c4c-4101-9db0-e7b63c016549 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:28.816055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483547-f019-43df-84e4-1e19656883f3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:28.831307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:28.852388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b676a5d-5109-4e18-8984-b2e57970bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:28.853044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676a5d-5109-4e18-8984-b2e57970bb08 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.853320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676a5d-5109-4e18-8984-b2e57970bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.854710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676a5d-5109-4e18-8984-b2e57970bb08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.855516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b676a5d-5109-4e18-8984-b2e57970bb08 None admin] RBAC: Adding query filter params (role.id=a1bdbf0d655e48afb678e720ec7d1d7a, user.id=3be196c23ac44331b6e6035129cedbad, scope.system=all) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:28.855961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b676a5d-5109-4e18-8984-b2e57970bb08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:28.857975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b676a5d-5109-4e18-8984-b2e57970bb08 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:28.872572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 180/368] 10.222.0.112 () {56 vars in 1313 bytes} [Fri Jun 3 16:13:28 2022] GET /identity/v3/role_assignments?user.id=3be196c23ac44331b6e6035129cedbad&scope.system=all&role.id=a1bdbf0d655e48afb678e720ec7d1d7a => generated 512 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:28.876442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b676a5d-5109-4e18-8984-b2e57970bb08 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:28.901315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fd002-9c4c-4101-9db0-e7b63c016549 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:28.948560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fe8d3-3952-4094-b8fd-0ce4bb155917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:28.949408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fe8d3-3952-4094-b8fd-0ce4bb155917 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:28.949693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fe8d3-3952-4094-b8fd-0ce4bb155917 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:28.950002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fe8d3-3952-4094-b8fd-0ce4bb155917 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:28.950744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fe8d3-3952-4094-b8fd-0ce4bb155917 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:28.951055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fe8d3-3952-4094-b8fd-0ce4bb155917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:28.953226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fe8d3-3952-4094-b8fd-0ce4bb155917 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:28.968316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 189/369] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:28 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:28.969223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fe8d3-3952-4094-b8fd-0ce4bb155917 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:29.012826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b676a5d-5109-4e18-8984-b2e57970bb08 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:29.042439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:29.051450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd7c63-08f3-4f23-a73a-e45745322907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:29.052142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd7c63-08f3-4f23-a73a-e45745322907 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:29.052424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd7c63-08f3-4f23-a73a-e45745322907 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:29.052776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd7c63-08f3-4f23-a73a-e45745322907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:29.053622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd7c63-08f3-4f23-a73a-e45745322907 None admin] RBAC: Adding query filter params (group.id=4bf5a037ff4a4161aa72821fecb84a38, role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:29.053932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd7c63-08f3-4f23-a73a-e45745322907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:29.055391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd7c63-08f3-4f23-a73a-e45745322907 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:29.063217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 181/370] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:28 2022] GET /identity/v3/role_assignments?group.id=4bf5a037ff4a4161aa72821fecb84a38&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 261 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:29.064133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd7c63-08f3-4f23-a73a-e45745322907 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:29.155661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:29.168310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fe8d3-3952-4094-b8fd-0ce4bb155917 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:29.213540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298102f-61ef-4d51-b6fa-46187bdc7a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:29.214565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298102f-61ef-4d51-b6fa-46187bdc7a0a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:29.214856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298102f-61ef-4d51-b6fa-46187bdc7a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:29.215136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298102f-61ef-4d51-b6fa-46187bdc7a0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:29.229585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298102f-61ef-4d51-b6fa-46187bdc7a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c298102f-61ef-4d51-b6fa-46187bdc7a0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:29.238260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:29.239237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:29.240080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 190/371] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:29.245983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298102f-61ef-4d51-b6fa-46187bdc7a0a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:29.271255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd7c63-08f3-4f23-a73a-e45745322907 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:29.357852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7be6d-6183-4cf7-928c-5b191749919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:29.360710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7be6d-6183-4cf7-928c-5b191749919c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:29.363035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7be6d-6183-4cf7-928c-5b191749919c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:29.363600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7be6d-6183-4cf7-928c-5b191749919c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:29.478457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298102f-61ef-4d51-b6fa-46187bdc7a0a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:29.498294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:29.515669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7be6d-6183-4cf7-928c-5b191749919c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:29.517568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7be6d-6183-4cf7-928c-5b191749919c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:29.531326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c299328-e147-4fe2-8e91-98f64158e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:29.531904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c299328-e147-4fe2-8e91-98f64158e545 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:29.532194 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c299328-e147-4fe2-8e91-98f64158e545 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:29.532476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c299328-e147-4fe2-8e91-98f64158e545 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:29.533238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c299328-e147-4fe2-8e91-98f64158e545 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:29.533549 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c299328-e147-4fe2-8e91-98f64158e545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:29.535060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c299328-e147-4fe2-8e91-98f64158e545 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:29.551957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 191/372] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:29.554491 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c299328-e147-4fe2-8e91-98f64158e545 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:29.583272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:29.634990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 182/373] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:29.642296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7be6d-6183-4cf7-928c-5b191749919c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:29.706226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c299328-e147-4fe2-8e91-98f64158e545 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:29.750232 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358608a8-5558-4a42-80f8-2cda3319d7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:29.751233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358608a8-5558-4a42-80f8-2cda3319d7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:29.751737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358608a8-5558-4a42-80f8-2cda3319d7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:29.752225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358608a8-5558-4a42-80f8-2cda3319d7e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:29.846752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358608a8-5558-4a42-80f8-2cda3319d7e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:29.848568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358608a8-5558-4a42-80f8-2cda3319d7e0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:29.849586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:29.871387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7be6d-6183-4cf7-928c-5b191749919c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:29.877186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:29.914082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b045-a369-4796-b2b8-b1385224defe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:29.915409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b045-a369-4796-b2b8-b1385224defe None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:29.916932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b045-a369-4796-b2b8-b1385224defe None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:29.917424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b045-a369-4796-b2b8-b1385224defe None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:29.918940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b045-a369-4796-b2b8-b1385224defe None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:29.920727 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b045-a369-4796-b2b8-b1385224defe None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:29.925304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 183/374] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:29 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:29.929388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b045-a369-4796-b2b8-b1385224defe None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:29.991926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 192/375] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:29.998115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358608a8-5558-4a42-80f8-2cda3319d7e0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:30.046615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b045-a369-4796-b2b8-b1385224defe None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:30.090903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25374550-4453-4a27-b7b6-06041642e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:30.092185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25374550-4453-4a27-b7b6-06041642e986 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:30.097194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25374550-4453-4a27-b7b6-06041642e986 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:30.097736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25374550-4453-4a27-b7b6-06041642e986 None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:30.099230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25374550-4453-4a27-b7b6-06041642e986 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:30.100961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25374550-4453-4a27-b7b6-06041642e986 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:30.102938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 184/376] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:29 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:30.112361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25374550-4453-4a27-b7b6-06041642e986 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:30.174736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:30.234708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358608a8-5558-4a42-80f8-2cda3319d7e0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:30.275730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:30.301193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be7cbb-5fed-4802-a20a-5272aab01a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:30.301984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be7cbb-5fed-4802-a20a-5272aab01a8e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:30.302261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be7cbb-5fed-4802-a20a-5272aab01a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:30.302532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be7cbb-5fed-4802-a20a-5272aab01a8e None admin] PATH_INFO: `/v3/projects/927da6a6fca54cd4babce7d6546e8b7f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:30.304375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be7cbb-5fed-4802-a20a-5272aab01a8e None admin] RBAC: Authorizing `identity:get_project(project_id=927da6a6fca54cd4babce7d6546e8b7f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:30.305830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be7cbb-5fed-4802-a20a-5272aab01a8e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:30.307532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 193/377] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:29 2022] GET /identity/v3/projects/927da6a6fca54cd4babce7d6546e8b7f => generated 345 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:30.309882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25374550-4453-4a27-b7b6-06041642e986 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:30.315691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be7cbb-5fed-4802-a20a-5272aab01a8e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:30.373888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946694-9a52-4c31-b0f7-9a78f7483e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:30.374549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946694-9a52-4c31-b0f7-9a78f7483e8f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:30.374827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946694-9a52-4c31-b0f7-9a78f7483e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:30.375098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946694-9a52-4c31-b0f7-9a78f7483e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:30.375951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1946694-9a52-4c31-b0f7-9a78f7483e8f None admin] RBAC: Adding query filter params (group.id=4bf5a037ff4a4161aa72821fecb84a38, role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:30.376255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1946694-9a52-4c31-b0f7-9a78f7483e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:30.377688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1946694-9a52-4c31-b0f7-9a78f7483e8f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:30.391760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 185/378] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:30 2022] GET /identity/v3/role_assignments?group.id=4bf5a037ff4a4161aa72821fecb84a38&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 261 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:30.469795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be7cbb-5fed-4802-a20a-5272aab01a8e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:30.511247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe09a6-47b0-403d-af0d-cb3f0bec1908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:30.512160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe09a6-47b0-403d-af0d-cb3f0bec1908 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:30.512434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe09a6-47b0-403d-af0d-cb3f0bec1908 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:30.512706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe09a6-47b0-403d-af0d-cb3f0bec1908 None admin] PATH_INFO: `/v3/groups/927642f1fbde4189ad1216e647628d5e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:30.520287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe09a6-47b0-403d-af0d-cb3f0bec1908 None admin] RBAC: Authorizing `identity:get_group(group_id=927642f1fbde4189ad1216e647628d5e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:30.521754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe09a6-47b0-403d-af0d-cb3f0bec1908 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:30.523944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 194/379] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:30 2022] GET /identity/v3/groups/927642f1fbde4189ad1216e647628d5e => generated 230 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:30.529807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946694-9a52-4c31-b0f7-9a78f7483e8f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:30.647330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:30.659747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946694-9a52-4c31-b0f7-9a78f7483e8f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:30.705048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f72ca-8318-4b00-afb9-a43dd3b96ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:30.705729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f72ca-8318-4b00-afb9-a43dd3b96ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:30.706011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f72ca-8318-4b00-afb9-a43dd3b96ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:30.706285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f72ca-8318-4b00-afb9-a43dd3b96ba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:30.707140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f72ca-8318-4b00-afb9-a43dd3b96ba5 None admin] RBAC: Adding query filter params (group.id=927642f1fbde4189ad1216e647628d5e, role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=927da6a6fca54cd4babce7d6546e8b7f) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:30.707508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f72ca-8318-4b00-afb9-a43dd3b96ba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:30.708995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f72ca-8318-4b00-afb9-a43dd3b96ba5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:30.719518 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 186/380] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:30 2022] GET /identity/v3/role_assignments?group.id=927642f1fbde4189ad1216e647628d5e&scope.project.id=927da6a6fca54cd4babce7d6546e8b7f&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 261 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:31.091309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16264620-47a5-4689-9b9f-fdd421ba49bc None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:31.091851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16264620-47a5-4689-9b9f-fdd421ba49bc None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:31.091851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16264620-47a5-4689-9b9f-fdd421ba49bc None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:31.093486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 195/381] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:31.099507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2ef2-1d51-4ee4-b224-b78b8898c830 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:31.099945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2ef2-1d51-4ee4-b224-b78b8898c830 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:31.100120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2ef2-1d51-4ee4-b224-b78b8898c830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:31.121272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a10b2ef2-1d51-4ee4-b224-b78b8898c830 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:31.121464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a10b2ef2-1d51-4ee4-b224-b78b8898c830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:31.213415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 187/382] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:31.239870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16264620-47a5-4689-9b9f-fdd421ba49bc None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:31.322083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:31.383315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16264620-47a5-4689-9b9f-fdd421ba49bc None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:31.422911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96d07a-9372-471a-a23f-2bf4c5be6c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:31.423758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96d07a-9372-471a-a23f-2bf4c5be6c4e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:31.424045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96d07a-9372-471a-a23f-2bf4c5be6c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:31.424320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96d07a-9372-471a-a23f-2bf4c5be6c4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:31.435748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96d07a-9372-471a-a23f-2bf4c5be6c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-ae96d07a-9372-471a-a23f-2bf4c5be6c4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:31.444016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:31.444940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:31.445960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 196/383] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:31.451297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b2ef2-1d51-4ee4-b224-b78b8898c830 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:31.576176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:31.594897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b2ef2-1d51-4ee4-b224-b78b8898c830 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:31.627265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dbb6a-8335-4f0c-8276-6ebb5078b7ae None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:31.627581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dbb6a-8335-4f0c-8276-6ebb5078b7ae None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:31.627996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dbb6a-8335-4f0c-8276-6ebb5078b7ae None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:31.629861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 197/384] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:31.637168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68499dad-bb5d-4016-a94c-75539d83e10b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:31.637440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68499dad-bb5d-4016-a94c-75539d83e10b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:31.637658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68499dad-bb5d-4016-a94c-75539d83e10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:31.640562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73360d-a795-4309-a03a-6599d0ed2f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:31.641473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73360d-a795-4309-a03a-6599d0ed2f48 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:31.641968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73360d-a795-4309-a03a-6599d0ed2f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:31.642443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73360d-a795-4309-a03a-6599d0ed2f48 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:31.643415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73360d-a795-4309-a03a-6599d0ed2f48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:31.644089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73360d-a795-4309-a03a-6599d0ed2f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:31.645690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73360d-a795-4309-a03a-6599d0ed2f48 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:31.655951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 188/385] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:31 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:31.661184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73360d-a795-4309-a03a-6599d0ed2f48 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:31.676730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-68499dad-bb5d-4016-a94c-75539d83e10b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:31.677969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-68499dad-bb5d-4016-a94c-75539d83e10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:31.773706 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73360d-a795-4309-a03a-6599d0ed2f48 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:31.794824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 198/386] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:31.816891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74911a34-d84c-4316-8a59-d9f6b88af835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:31.818188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74911a34-d84c-4316-8a59-d9f6b88af835 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:31.818676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74911a34-d84c-4316-8a59-d9f6b88af835 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:31.819189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74911a34-d84c-4316-8a59-d9f6b88af835 None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:31.820644 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74911a34-d84c-4316-8a59-d9f6b88af835 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:31.822349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74911a34-d84c-4316-8a59-d9f6b88af835 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:31.824713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 189/387] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:31 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:31.833698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68499dad-bb5d-4016-a94c-75539d83e10b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:31.834961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74911a34-d84c-4316-8a59-d9f6b88af835 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:31.864236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:31.903227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:31.956863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68499dad-bb5d-4016-a94c-75539d83e10b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:31.965897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74911a34-d84c-4316-8a59-d9f6b88af835 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:32.004503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99fa6f-a841-4b1c-9f9a-ae156e6f8480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:32.004853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99fa6f-a841-4b1c-9f9a-ae156e6f8480 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:32.005136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99fa6f-a841-4b1c-9f9a-ae156e6f8480 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:32.005414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99fa6f-a841-4b1c-9f9a-ae156e6f8480 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:32.008027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99fa6f-a841-4b1c-9f9a-ae156e6f8480 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:32.009508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99fa6f-a841-4b1c-9f9a-ae156e6f8480 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:32.011807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 199/388] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:31 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:32.012234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7204-68cc-4e21-849b-9d97fcdbc6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:32.013158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7204-68cc-4e21-849b-9d97fcdbc6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:32.013450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7204-68cc-4e21-849b-9d97fcdbc6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:32.013796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7204-68cc-4e21-849b-9d97fcdbc6b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:32.017028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99fa6f-a841-4b1c-9f9a-ae156e6f8480 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:32.027237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7204-68cc-4e21-849b-9d97fcdbc6b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-77eb7204-68cc-4e21-849b-9d97fcdbc6b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:32.036938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:32.037945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:32.038761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 190/389] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:32.044044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7204-68cc-4e21-849b-9d97fcdbc6b1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:32.154573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99fa6f-a841-4b1c-9f9a-ae156e6f8480 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:32.183117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:32.207344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5a1ea-46c2-4cc0-ab32-c72681124237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:32.208720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5a1ea-46c2-4cc0-ab32-c72681124237 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:32.209258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5a1ea-46c2-4cc0-ab32-c72681124237 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:32.209734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5a1ea-46c2-4cc0-ab32-c72681124237 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0/groups/4bf5a037ff4a4161aa72821fecb84a38/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:32.212057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5a1ea-46c2-4cc0-ab32-c72681124237 None admin] RBAC: Authorizing `identity:create_grant(project_id=4148325ec8614e9bbea65c25532b96a0, group_id=4bf5a037ff4a4161aa72821fecb84a38, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:32.214321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5a1ea-46c2-4cc0-ab32-c72681124237 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:32.217972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:32.234277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 200/390] 10.222.0.112 () {58 vars in 1447 bytes} [Fri Jun 3 16:13:32 2022] PUT /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0/groups/4bf5a037ff4a4161aa72821fecb84a38/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:13:32.281784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7204-68cc-4e21-849b-9d97fcdbc6b1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:32.329954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3c17b-c043-4ac7-8a46-2945da91b4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:32.330643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3c17b-c043-4ac7-8a46-2945da91b4ae None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:32.330929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3c17b-c043-4ac7-8a46-2945da91b4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:32.331207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3c17b-c043-4ac7-8a46-2945da91b4ae None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:32.332010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3c17b-c043-4ac7-8a46-2945da91b4ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:32.332320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3c17b-c043-4ac7-8a46-2945da91b4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:32.333740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3c17b-c043-4ac7-8a46-2945da91b4ae None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:32.348611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 191/391] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:32 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:32.354015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5a1ea-46c2-4cc0-ab32-c72681124237 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:32.496755 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5a1ea-46c2-4cc0-ab32-c72681124237 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:32.543070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cbd06-06f4-4b74-8123-b28ef9617236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:32.544389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cbd06-06f4-4b74-8123-b28ef9617236 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:32.544893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cbd06-06f4-4b74-8123-b28ef9617236 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:32.545373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cbd06-06f4-4b74-8123-b28ef9617236 None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:32.547520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cbd06-06f4-4b74-8123-b28ef9617236 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:32.549269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cbd06-06f4-4b74-8123-b28ef9617236 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:32.551565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 201/392] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:32 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:32.556405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa8685-9b34-4f95-992d-08c1d7f29eca None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:32.556686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa8685-9b34-4f95-992d-08c1d7f29eca None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:32.556971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa8685-9b34-4f95-992d-08c1d7f29eca None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:32.557292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cbd06-06f4-4b74-8123-b28ef9617236 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:32.558734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 192/393] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:32.565058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b80b1-f815-4590-975f-41b3bda4688a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:32.565360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b80b1-f815-4590-975f-41b3bda4688a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:32.565627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b80b1-f815-4590-975f-41b3bda4688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:32.585189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7f4b80b1-f815-4590-975f-41b3bda4688a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:32.586408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7f4b80b1-f815-4590-975f-41b3bda4688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:32.625518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:32.702298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cbd06-06f4-4b74-8123-b28ef9617236 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:32.721818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 193/394] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:32.742106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c9a54-0937-4214-ba12-5c87cdbbad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:32.743372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9a54-0937-4214-ba12-5c87cdbbad6b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:32.743921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9a54-0937-4214-ba12-5c87cdbbad6b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:32.746691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9a54-0937-4214-ba12-5c87cdbbad6b None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:32.748413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c9a54-0937-4214-ba12-5c87cdbbad6b None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:32.750714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c9a54-0937-4214-ba12-5c87cdbbad6b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:32.752995 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 202/395] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:32 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:32.758369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b80b1-f815-4590-975f-41b3bda4688a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:32.761976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c9a54-0937-4214-ba12-5c87cdbbad6b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:32.879470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:32.926896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b80b1-f815-4590-975f-41b3bda4688a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:32.957879 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c9a54-0937-4214-ba12-5c87cdbbad6b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:32.972007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84241-5e54-4b12-aaa9-a53bcfd06845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:32.973320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84241-5e54-4b12-aaa9-a53bcfd06845 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:32.973809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84241-5e54-4b12-aaa9-a53bcfd06845 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:32.974297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84241-5e54-4b12-aaa9-a53bcfd06845 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0/groups/4bf5a037ff4a4161aa72821fecb84a38/roles/45adf513980e4f8a9eab6f81b4fd8b77` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:32.976951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a84241-5e54-4b12-aaa9-a53bcfd06845 None admin] RBAC: Authorizing `identity:create_grant(project_id=4148325ec8614e9bbea65c25532b96a0, group_id=4bf5a037ff4a4161aa72821fecb84a38, role_id=45adf513980e4f8a9eab6f81b4fd8b77)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:32.977958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:32.980110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a84241-5e54-4b12-aaa9-a53bcfd06845 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:32.998050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 194/396] 10.222.0.112 () {58 vars in 1447 bytes} [Fri Jun 3 16:13:32 2022] PUT /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0/groups/4bf5a037ff4a4161aa72821fecb84a38/roles/45adf513980e4f8a9eab6f81b4fd8b77 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:13:33.021218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70316aa8-135f-486a-a143-b354d337c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:33.022382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316aa8-135f-486a-a143-b354d337c586 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:33.022884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316aa8-135f-486a-a143-b354d337c586 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:33.023357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316aa8-135f-486a-a143-b354d337c586 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:33.036841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70316aa8-135f-486a-a143-b354d337c586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-70316aa8-135f-486a-a143-b354d337c586 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:33.046270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:33.047220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:33.048061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:33.051052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 203/397] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:33.056688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84241-5e54-4b12-aaa9-a53bcfd06845 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:33.186415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84241-5e54-4b12-aaa9-a53bcfd06845 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:33.217251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:33.226986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd85c-cf36-44ec-a3cf-a323c4db0038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:33.227798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd85c-cf36-44ec-a3cf-a323c4db0038 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:33.228219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd85c-cf36-44ec-a3cf-a323c4db0038 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:33.228495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd85c-cf36-44ec-a3cf-a323c4db0038 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:33.229268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bd85c-cf36-44ec-a3cf-a323c4db0038 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:33.229585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bd85c-cf36-44ec-a3cf-a323c4db0038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:33.230991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bd85c-cf36-44ec-a3cf-a323c4db0038 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:33.244699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 195/398] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:33 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:33.250272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70316aa8-135f-486a-a143-b354d337c586 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:33.373034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70316aa8-135f-486a-a143-b354d337c586 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:33.413970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b80e52-05a5-4066-ac80-e0b3571e3893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:33.414848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b80e52-05a5-4066-ac80-e0b3571e3893 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:33.415135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b80e52-05a5-4066-ac80-e0b3571e3893 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:33.415418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b80e52-05a5-4066-ac80-e0b3571e3893 None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:33.416769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b80e52-05a5-4066-ac80-e0b3571e3893 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:33.418230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b80e52-05a5-4066-ac80-e0b3571e3893 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:33.419891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 204/399] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:33 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:33.426367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd85c-cf36-44ec-a3cf-a323c4db0038 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:33.543841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd85c-cf36-44ec-a3cf-a323c4db0038 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:33.556695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ac917-9def-4b33-b24b-93c8978db01b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:33.557001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ac917-9def-4b33-b24b-93c8978db01b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:33.557256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ac917-9def-4b33-b24b-93c8978db01b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:33.559021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 205/400] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:13:33.565095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577407d4-8b58-4ddc-82ab-8aeef79acce6 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:33.565398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577407d4-8b58-4ddc-82ab-8aeef79acce6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:33.565655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577407d4-8b58-4ddc-82ab-8aeef79acce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:33.584723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d810dd-a70c-42d2-9072-75725723bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:33.585613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d810dd-a70c-42d2-9072-75725723bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:33.585898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d810dd-a70c-42d2-9072-75725723bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:33.586179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d810dd-a70c-42d2-9072-75725723bdc7 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:33.587397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d810dd-a70c-42d2-9072-75725723bdc7 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:33.588926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d810dd-a70c-42d2-9072-75725723bdc7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:33.591128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 196/401] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:33 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:33.600092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-577407d4-8b58-4ddc-82ab-8aeef79acce6 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:33.601354 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-577407d4-8b58-4ddc-82ab-8aeef79acce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:33.606701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d810dd-a70c-42d2-9072-75725723bdc7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:33.664630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:33.678793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:33.722625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d810dd-a70c-42d2-9072-75725723bdc7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:33.759258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd1277-2ad1-4d2b-8a39-84749a58ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:33.760333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd1277-2ad1-4d2b-8a39-84749a58ffef None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:33.760690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd1277-2ad1-4d2b-8a39-84749a58ffef None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:33.761076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd1277-2ad1-4d2b-8a39-84749a58ffef None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/groups/4bf5a037ff4a4161aa72821fecb84a38/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:33.763422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd1277-2ad1-4d2b-8a39-84749a58ffef None admin] RBAC: Authorizing `identity:create_grant(project_id=cda8b9fce6604ccbaa4b14c8377676ca, group_id=4bf5a037ff4a4161aa72821fecb84a38, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:33.765216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd1277-2ad1-4d2b-8a39-84749a58ffef None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:33.778286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 206/402] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:33.784679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 197/403] 10.222.0.112 () {58 vars in 1447 bytes} [Fri Jun 3 16:13:33 2022] PUT /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/groups/4bf5a037ff4a4161aa72821fecb84a38/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:13:33.808001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577407d4-8b58-4ddc-82ab-8aeef79acce6 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:33.973527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577407d4-8b58-4ddc-82ab-8aeef79acce6 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:34.020738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990d11c-b683-4e06-9207-5526f0ca7c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:34.021560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990d11c-b683-4e06-9207-5526f0ca7c82 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:34.021835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990d11c-b683-4e06-9207-5526f0ca7c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:34.022106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990d11c-b683-4e06-9207-5526f0ca7c82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:34.040249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990d11c-b683-4e06-9207-5526f0ca7c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3990d11c-b683-4e06-9207-5526f0ca7c82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:34.049083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:34.050024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:34.050911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:34.055171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 207/404] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:34.057202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd1277-2ad1-4d2b-8a39-84749a58ffef None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:34.092846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a6732-8727-4497-be07-a6067cb4792f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:34.093191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a6732-8727-4497-be07-a6067cb4792f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:34.093603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a6732-8727-4497-be07-a6067cb4792f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:34.095360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 208/405] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:13:34.101068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f2917-a877-44be-a251-8f2892d88cbf None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:34.101404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f2917-a877-44be-a251-8f2892d88cbf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:34.101621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f2917-a877-44be-a251-8f2892d88cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:34.138771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0c8f2917-a877-44be-a251-8f2892d88cbf None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:34.140690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0c8f2917-a877-44be-a251-8f2892d88cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:34.192048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:34.222867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd1277-2ad1-4d2b-8a39-84749a58ffef None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:34.243291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:34.267798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2e736-0e93-4f28-8cfb-94a1cf06f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:34.268457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2e736-0e93-4f28-8cfb-94a1cf06f21f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:34.268738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2e736-0e93-4f28-8cfb-94a1cf06f21f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:34.269009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2e736-0e93-4f28-8cfb-94a1cf06f21f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:34.269770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2e736-0e93-4f28-8cfb-94a1cf06f21f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:34.270070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2e736-0e93-4f28-8cfb-94a1cf06f21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:34.271470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2e736-0e93-4f28-8cfb-94a1cf06f21f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:34.288807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 198/406] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:34 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:34.290776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2e736-0e93-4f28-8cfb-94a1cf06f21f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:34.291503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 209/407] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:34.324348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f2917-a877-44be-a251-8f2892d88cbf None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:34.414798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2e736-0e93-4f28-8cfb-94a1cf06f21f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:34.452671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650ed69-da5f-482b-8bd7-e672ea84a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:34.453916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650ed69-da5f-482b-8bd7-e672ea84a9da None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:34.454390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650ed69-da5f-482b-8bd7-e672ea84a9da None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:34.454854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650ed69-da5f-482b-8bd7-e672ea84a9da None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:34.456327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650ed69-da5f-482b-8bd7-e672ea84a9da None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:34.458124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650ed69-da5f-482b-8bd7-e672ea84a9da None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:34.464676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 199/408] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:34 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:34.466591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650ed69-da5f-482b-8bd7-e672ea84a9da None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:34.523125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:34.582022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f2917-a877-44be-a251-8f2892d88cbf None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:34.586352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650ed69-da5f-482b-8bd7-e672ea84a9da None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:34.626582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05002d-1eda-43e4-8938-e755a88a8444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:34.627909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05002d-1eda-43e4-8938-e755a88a8444 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:34.628481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05002d-1eda-43e4-8938-e755a88a8444 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:34.629027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05002d-1eda-43e4-8938-e755a88a8444 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:34.630625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05002d-1eda-43e4-8938-e755a88a8444 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:34.632355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05002d-1eda-43e4-8938-e755a88a8444 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:34.639188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 200/409] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:34 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:34.640840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05002d-1eda-43e4-8938-e755a88a8444 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:34.644333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d4965-7449-48db-8664-888f9cc0c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:34.645153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4965-7449-48db-8664-888f9cc0c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:34.645455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4965-7449-48db-8664-888f9cc0c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:34.646607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d4965-7449-48db-8664-888f9cc0c5d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:34.665613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d4965-7449-48db-8664-888f9cc0c5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-585d4965-7449-48db-8664-888f9cc0c5d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:34.681783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:34.682785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:34.684267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 210/410] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:13:34.689078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d4965-7449-48db-8664-888f9cc0c5d6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:34.727184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:34.767864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05002d-1eda-43e4-8938-e755a88a8444 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:34.804566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:34.827135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102626b6-717d-437b-8b70-8a4d07376c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:34.828443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102626b6-717d-437b-8b70-8a4d07376c0c None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:34.828922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102626b6-717d-437b-8b70-8a4d07376c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:34.829392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102626b6-717d-437b-8b70-8a4d07376c0c None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/groups/4bf5a037ff4a4161aa72821fecb84a38/roles/45adf513980e4f8a9eab6f81b4fd8b77` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:34.832094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102626b6-717d-437b-8b70-8a4d07376c0c None admin] RBAC: Authorizing `identity:create_grant(project_id=cda8b9fce6604ccbaa4b14c8377676ca, group_id=4bf5a037ff4a4161aa72821fecb84a38, role_id=45adf513980e4f8a9eab6f81b4fd8b77)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:34.833837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102626b6-717d-437b-8b70-8a4d07376c0c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:34.853170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 201/411] 10.222.0.112 () {58 vars in 1447 bytes} [Fri Jun 3 16:13:34 2022] PUT /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca/groups/4bf5a037ff4a4161aa72821fecb84a38/roles/45adf513980e4f8a9eab6f81b4fd8b77 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:13:34.910072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d4965-7449-48db-8664-888f9cc0c5d6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:34.987391 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92749f7-9eb9-42ba-9f6e-7428ef333237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:34.988130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92749f7-9eb9-42ba-9f6e-7428ef333237 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:34.988414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92749f7-9eb9-42ba-9f6e-7428ef333237 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:34.988693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92749f7-9eb9-42ba-9f6e-7428ef333237 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:34.989488 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92749f7-9eb9-42ba-9f6e-7428ef333237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:34.989866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92749f7-9eb9-42ba-9f6e-7428ef333237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:34.991336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92749f7-9eb9-42ba-9f6e-7428ef333237 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:35.005046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 211/412] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:35.010641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102626b6-717d-437b-8b70-8a4d07376c0c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:35.196252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102626b6-717d-437b-8b70-8a4d07376c0c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:35.238988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9986c-5aed-4391-8461-cd8623b1f99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:35.239916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9986c-5aed-4391-8461-cd8623b1f99e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:35.240203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9986c-5aed-4391-8461-cd8623b1f99e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:35.240492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9986c-5aed-4391-8461-cd8623b1f99e None admin] PATH_INFO: `/v3/groups/927642f1fbde4189ad1216e647628d5e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:35.241855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9986c-5aed-4391-8461-cd8623b1f99e None admin] RBAC: Authorizing `identity:get_group(group_id=927642f1fbde4189ad1216e647628d5e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:35.243348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9986c-5aed-4391-8461-cd8623b1f99e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:35.245429 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 202/413] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:35 2022] GET /identity/v3/groups/927642f1fbde4189ad1216e647628d5e => generated 230 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:35.251736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92749f7-9eb9-42ba-9f6e-7428ef333237 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:35.369359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:35.399541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92749f7-9eb9-42ba-9f6e-7428ef333237 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:35.448453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503d47f-c7d5-4602-988d-4e044eccb06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:35.449687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503d47f-c7d5-4602-988d-4e044eccb06a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:35.450187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503d47f-c7d5-4602-988d-4e044eccb06a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:35.450676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503d47f-c7d5-4602-988d-4e044eccb06a None admin] PATH_INFO: `/v3/projects/927da6a6fca54cd4babce7d6546e8b7f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:35.452847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503d47f-c7d5-4602-988d-4e044eccb06a None admin] RBAC: Authorizing `identity:get_project(project_id=927da6a6fca54cd4babce7d6546e8b7f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:35.454577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503d47f-c7d5-4602-988d-4e044eccb06a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:35.456591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 212/414] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:35 2022] GET /identity/v3/projects/927da6a6fca54cd4babce7d6546e8b7f => generated 345 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:35.464689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9986c-5aed-4391-8461-cd8623b1f99e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:35.589150 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:35.688330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9986c-5aed-4391-8461-cd8623b1f99e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:35.738248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f4c84-1ad6-4de9-9f39-a8a9274dfc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:35.739061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4c84-1ad6-4de9-9f39-a8a9274dfc60 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:35.739345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4c84-1ad6-4de9-9f39-a8a9274dfc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:35.739664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4c84-1ad6-4de9-9f39-a8a9274dfc60 None admin] PATH_INFO: `/v3/projects/927da6a6fca54cd4babce7d6546e8b7f/groups/927642f1fbde4189ad1216e647628d5e/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:35.741687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f4c84-1ad6-4de9-9f39-a8a9274dfc60 None admin] RBAC: Authorizing `identity:create_grant(project_id=927da6a6fca54cd4babce7d6546e8b7f, group_id=927642f1fbde4189ad1216e647628d5e, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:35.743138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f4c84-1ad6-4de9-9f39-a8a9274dfc60 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:35.763923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 203/415] 10.222.0.112 () {58 vars in 1447 bytes} [Fri Jun 3 16:13:35 2022] PUT /identity/v3/projects/927da6a6fca54cd4babce7d6546e8b7f/groups/927642f1fbde4189ad1216e647628d5e/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:13:35.785822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565928f-cab0-4f5e-a916-0afce2533215 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:35.786155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565928f-cab0-4f5e-a916-0afce2533215 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:35.786437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565928f-cab0-4f5e-a916-0afce2533215 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:35.788267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 213/416] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:35.794663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf24cc-842c-46cc-b039-053cfb4ba13b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:35.794954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf24cc-842c-46cc-b039-053cfb4ba13b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:35.795243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf24cc-842c-46cc-b039-053cfb4ba13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:35.816019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9faf24cc-842c-46cc-b039-053cfb4ba13b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:35.817302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9faf24cc-842c-46cc-b039-053cfb4ba13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:35.924309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 204/417] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:35.960343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565928f-cab0-4f5e-a916-0afce2533215 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:36.080735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565928f-cab0-4f5e-a916-0afce2533215 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:36.119718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc2745-d9f4-4684-b1ab-30b69f744052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:36.120536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc2745-d9f4-4684-b1ab-30b69f744052 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:36.120820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc2745-d9f4-4684-b1ab-30b69f744052 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:36.121099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc2745-d9f4-4684-b1ab-30b69f744052 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:36.134034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc2745-d9f4-4684-b1ab-30b69f744052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-05bc2745-d9f4-4684-b1ab-30b69f744052 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:36.142020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:36.142996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:36.144246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 214/418] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:36.152744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf24cc-842c-46cc-b039-053cfb4ba13b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:36.214898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:36.320292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf24cc-842c-46cc-b039-053cfb4ba13b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:36.365817 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24aa68-7f48-4193-a53c-4908c913c107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:36.366419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24aa68-7f48-4193-a53c-4908c913c107 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:36.366705 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24aa68-7f48-4193-a53c-4908c913c107 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:36.366987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24aa68-7f48-4193-a53c-4908c913c107 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:36.367791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24aa68-7f48-4193-a53c-4908c913c107 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:36.368108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24aa68-7f48-4193-a53c-4908c913c107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:36.369495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24aa68-7f48-4193-a53c-4908c913c107 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:36.383743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 205/419] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:36 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:36.389255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc2745-d9f4-4684-b1ab-30b69f744052 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:36.411637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:36.493293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c99cd5-0dd7-40fd-bfc4-df2e953e2f42 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:36.493673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c99cd5-0dd7-40fd-bfc4-df2e953e2f42 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:36.493923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c99cd5-0dd7-40fd-bfc4-df2e953e2f42 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:36.495575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 206/420] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:36.501973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fe42f-3666-464f-aa65-aa592030c834 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:36.502265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fe42f-3666-464f-aa65-aa592030c834 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:36.502541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fe42f-3666-464f-aa65-aa592030c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:36.531347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ae7fe42f-3666-464f-aa65-aa592030c834 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:36.532714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ae7fe42f-3666-464f-aa65-aa592030c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:36.624219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc2745-d9f4-4684-b1ab-30b69f744052 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:36.671100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 207/421] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:36.673176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0576-77cc-4194-8b03-9a81ec9825e3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:36.673667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0576-77cc-4194-8b03-9a81ec9825e3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:36.674125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0576-77cc-4194-8b03-9a81ec9825e3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:36.675912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 208/422] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:36.676024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0289cea-87e0-42cf-b1fa-fea89b9378fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:36.678013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0289cea-87e0-42cf-b1fa-fea89b9378fa None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:36.678496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0289cea-87e0-42cf-b1fa-fea89b9378fa None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:36.679055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0289cea-87e0-42cf-b1fa-fea89b9378fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:36.688802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722c6c-f252-473a-9d6b-de170a6ed1c4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:36.689387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722c6c-f252-473a-9d6b-de170a6ed1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:36.689858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722c6c-f252-473a-9d6b-de170a6ed1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:36.711331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1b722c6c-f252-473a-9d6b-de170a6ed1c4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:36.712572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1b722c6c-f252-473a-9d6b-de170a6ed1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:36.735955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:36.772079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0289cea-87e0-42cf-b1fa-fea89b9378fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:36.773583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0289cea-87e0-42cf-b1fa-fea89b9378fa None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:36.785125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:36.808919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 209/423] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:36.811405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b722c6c-f252-473a-9d6b-de170a6ed1c4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:36.913582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 215/424] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:36.915127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0289cea-87e0-42cf-b1fa-fea89b9378fa None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:36.939900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b722c6c-f252-473a-9d6b-de170a6ed1c4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:36.977193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8897e7-cba2-445f-b243-8f5f16149611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:36.977879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8897e7-cba2-445f-b243-8f5f16149611 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:36.978162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8897e7-cba2-445f-b243-8f5f16149611 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:36.978439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8897e7-cba2-445f-b243-8f5f16149611 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:36.989763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8897e7-cba2-445f-b243-8f5f16149611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3b8897e7-cba2-445f-b243-8f5f16149611 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:36.998298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:36.999796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:37.000611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:37.003806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 210/425] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:37.004643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8897e7-cba2-445f-b243-8f5f16149611 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:37.027085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:37.060758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0289cea-87e0-42cf-b1fa-fea89b9378fa None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:37.073638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:37.116616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef304dc-eb2b-4e83-8bd9-5755ce2bcc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:37.117955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef304dc-eb2b-4e83-8bd9-5755ce2bcc2f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:37.118644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef304dc-eb2b-4e83-8bd9-5755ce2bcc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:37.119491 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef304dc-eb2b-4e83-8bd9-5755ce2bcc2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:37.122317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8897e7-cba2-445f-b243-8f5f16149611 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:37.133941 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef304dc-eb2b-4e83-8bd9-5755ce2bcc2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-0ef304dc-eb2b-4e83-8bd9-5755ce2bcc2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:37.145002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:37.145944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 16:13:37.146767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:37.149698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 216/426] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:37.150746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef304dc-eb2b-4e83-8bd9-5755ce2bcc2f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:37.174125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cacff-e4a1-4141-9f81-e7d52eb29196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:37.178434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cacff-e4a1-4141-9f81-e7d52eb29196 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:37.178876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cacff-e4a1-4141-9f81-e7d52eb29196 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:37.179577 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cacff-e4a1-4141-9f81-e7d52eb29196 None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:37.181685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cacff-e4a1-4141-9f81-e7d52eb29196 None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:37.183972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cacff-e4a1-4141-9f81-e7d52eb29196 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:37.186983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 211/427] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:37 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:37.188503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cacff-e4a1-4141-9f81-e7d52eb29196 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:37.266669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef304dc-eb2b-4e83-8bd9-5755ce2bcc2f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:37.283267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:37.302256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cacff-e4a1-4141-9f81-e7d52eb29196 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:37.303816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02e471-4698-4e75-b6ce-0c7e22f08773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:37.304593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02e471-4698-4e75-b6ce-0c7e22f08773 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:37.305038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02e471-4698-4e75-b6ce-0c7e22f08773 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:37.305411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02e471-4698-4e75-b6ce-0c7e22f08773 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:37.306276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02e471-4698-4e75-b6ce-0c7e22f08773 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:37.306720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02e471-4698-4e75-b6ce-0c7e22f08773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:37.308341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02e471-4698-4e75-b6ce-0c7e22f08773 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:37.322728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 217/428] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:37 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:37.323837 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02e471-4698-4e75-b6ce-0c7e22f08773 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:37.340528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5387a55-42d6-4fe8-8130-d165dffa52e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:37.341277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387a55-42d6-4fe8-8130-d165dffa52e7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:37.341568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387a55-42d6-4fe8-8130-d165dffa52e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:37.341848 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387a55-42d6-4fe8-8130-d165dffa52e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:37.342658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387a55-42d6-4fe8-8130-d165dffa52e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:37.342968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387a55-42d6-4fe8-8130-d165dffa52e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:37.344459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387a55-42d6-4fe8-8130-d165dffa52e7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:37.354565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 212/429] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:13:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:37.355463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5387a55-42d6-4fe8-8130-d165dffa52e7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:37.368058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:37.472204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02e471-4698-4e75-b6ce-0c7e22f08773 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:37.494789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5387a55-42d6-4fe8-8130-d165dffa52e7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:37.522384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee0bb3-356b-410e-abbd-f35595da3f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:37.523250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee0bb3-356b-410e-abbd-f35595da3f7e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:37.524337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee0bb3-356b-410e-abbd-f35595da3f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:37.524797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee0bb3-356b-410e-abbd-f35595da3f7e None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:37.526470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee0bb3-356b-410e-abbd-f35595da3f7e None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:37.529250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee0bb3-356b-410e-abbd-f35595da3f7e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:37.537138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 218/430] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:37 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:37.537319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee0bb3-356b-410e-abbd-f35595da3f7e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:37.550789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12a885-b745-4941-8415-93c5436d1484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:37.551764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12a885-b745-4941-8415-93c5436d1484 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:37.552240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12a885-b745-4941-8415-93c5436d1484 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:37.553051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12a885-b745-4941-8415-93c5436d1484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:37.575956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:37.648703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12a885-b745-4941-8415-93c5436d1484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:37.650957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12a885-b745-4941-8415-93c5436d1484 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:37.683967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:37.692842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee0bb3-356b-410e-abbd-f35595da3f7e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:37.746228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e23ec-0e33-494d-a192-6b2b519b682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:37.746806 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e23ec-0e33-494d-a192-6b2b519b682e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:37.747076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e23ec-0e33-494d-a192-6b2b519b682e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:37.747846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e23ec-0e33-494d-a192-6b2b519b682e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:37.783687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 213/431] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:37.784926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12a885-b745-4941-8415-93c5436d1484 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:37.850232 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e23ec-0e33-494d-a192-6b2b519b682e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:37.852224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e23ec-0e33-494d-a192-6b2b519b682e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:37.862703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:37.931027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12a885-b745-4941-8415-93c5436d1484 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:37.969951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:37.970334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46311-3e4d-4a06-9a04-dcbf453acf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:37.971009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46311-3e4d-4a06-9a04-dcbf453acf8f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:37.971295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46311-3e4d-4a06-9a04-dcbf453acf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:37.971612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb46311-3e4d-4a06-9a04-dcbf453acf8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:37.972471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb46311-3e4d-4a06-9a04-dcbf453acf8f None admin] RBAC: Adding query filter params (group.id=4bf5a037ff4a4161aa72821fecb84a38, role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=4148325ec8614e9bbea65c25532b96a0) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:37.972788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb46311-3e4d-4a06-9a04-dcbf453acf8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:37.974244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb46311-3e4d-4a06-9a04-dcbf453acf8f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:37.983638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 219/432] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:37.983638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c892-6701-4fb1-b5c7-70c1d880a7ec None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:37.983638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c892-6701-4fb1-b5c7-70c1d880a7ec None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:37.983638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8c892-6701-4fb1-b5c7-70c1d880a7ec None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:37.983638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 220/433] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:37.983638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c892-6701-4fb1-b5c7-70c1d880a7ec None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:37.988951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 214/434] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:37 2022] GET /identity/v3/role_assignments?group.id=4bf5a037ff4a4161aa72821fecb84a38&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 613 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:37.989691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46311-3e4d-4a06-9a04-dcbf453acf8f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:38.149477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb46311-3e4d-4a06-9a04-dcbf453acf8f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:38.173640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8c892-6701-4fb1-b5c7-70c1d880a7ec None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:38.181915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:38.214692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0fa7a-72f6-4994-8bfa-2e0cf7a74087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:38.220429 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fa7a-72f6-4994-8bfa-2e0cf7a74087 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.220993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fa7a-72f6-4994-8bfa-2e0cf7a74087 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.221444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fa7a-72f6-4994-8bfa-2e0cf7a74087 None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.223210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0fa7a-72f6-4994-8bfa-2e0cf7a74087 None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:38.226462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0fa7a-72f6-4994-8bfa-2e0cf7a74087 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:38.230124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 215/435] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:37 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:38.232274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b3dc4-b5d6-4207-b4f2-9fe7351cd655 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.233902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b3dc4-b5d6-4207-b4f2-9fe7351cd655 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.234871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b3dc4-b5d6-4207-b4f2-9fe7351cd655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.264457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-051b3dc4-b5d6-4207-b4f2-9fe7351cd655 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:38.265119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5268b-0997-42f0-9709-369896bac44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:38.265996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5268b-0997-42f0-9709-369896bac44d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.266272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5268b-0997-42f0-9709-369896bac44d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.266538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5268b-0997-42f0-9709-369896bac44d None admin] PATH_INFO: `/v3/projects/4148325ec8614e9bbea65c25532b96a0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.267355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-051b3dc4-b5d6-4207-b4f2-9fe7351cd655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:38.267820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5268b-0997-42f0-9709-369896bac44d None admin] RBAC: Authorizing `identity:get_project(project_id=4148325ec8614e9bbea65c25532b96a0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:38.269311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5268b-0997-42f0-9709-369896bac44d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:38.271099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 221/436] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:37 2022] GET /identity/v3/projects/4148325ec8614e9bbea65c25532b96a0 => generated 299 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:38.277306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5268b-0997-42f0-9709-369896bac44d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:38.400419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:38.400894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 216/437] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:38.402763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b3dc4-b5d6-4207-b4f2-9fe7351cd655 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:38.458390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5268b-0997-42f0-9709-369896bac44d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:38.510474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba337cb-df53-4647-b485-19d61b14c261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:38.511618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba337cb-df53-4647-b485-19d61b14c261 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.512011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba337cb-df53-4647-b485-19d61b14c261 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.512376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba337cb-df53-4647-b485-19d61b14c261 None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.513671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba337cb-df53-4647-b485-19d61b14c261 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:38.515885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba337cb-df53-4647-b485-19d61b14c261 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:38.519018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 222/438] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:38 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:38.520778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b157889-423f-4a5f-b6aa-4d070d00502e None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.521166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b157889-423f-4a5f-b6aa-4d070d00502e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.521544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b157889-423f-4a5f-b6aa-4d070d00502e None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.523701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 223/439] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:38.524575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b157889-423f-4a5f-b6aa-4d070d00502e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:38.590792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b3dc4-b5d6-4207-b4f2-9fe7351cd655 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:38.600870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:38.628073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a686863-5e2c-43b3-a572-6c777309b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:38.629246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a686863-5e2c-43b3-a572-6c777309b938 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.629530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a686863-5e2c-43b3-a572-6c777309b938 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.629812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a686863-5e2c-43b3-a572-6c777309b938 None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.630986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a686863-5e2c-43b3-a572-6c777309b938 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:38.632534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a686863-5e2c-43b3-a572-6c777309b938 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:38.634154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 217/440] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:38 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:38.634917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a686863-5e2c-43b3-a572-6c777309b938 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:38.656614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b157889-423f-4a5f-b6aa-4d070d00502e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:38.686155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:38.691345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a197e-fbfb-4554-be8a-bb6ccab0e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:38.692175 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a197e-fbfb-4554-be8a-bb6ccab0e97c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.692458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a197e-fbfb-4554-be8a-bb6ccab0e97c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.692733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a197e-fbfb-4554-be8a-bb6ccab0e97c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.703497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a197e-fbfb-4554-be8a-bb6ccab0e97c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-007a197e-fbfb-4554-be8a-bb6ccab0e97c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:38.711661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:38.712643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 224/441] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:38.718944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc57d1-80af-4aa7-b517-dc081acacc9a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.719692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc57d1-80af-4aa7-b517-dc081acacc9a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.719692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc57d1-80af-4aa7-b517-dc081acacc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.732163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a4dc57d1-80af-4aa7-b517-dc081acacc9a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:38.733395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a4dc57d1-80af-4aa7-b517-dc081acacc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:38.737061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a686863-5e2c-43b3-a572-6c777309b938 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:38.769751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330db3-90d0-49d6-b24e-a76f16ef291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:38.770393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330db3-90d0-49d6-b24e-a76f16ef291e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.770672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330db3-90d0-49d6-b24e-a76f16ef291e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.770942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330db3-90d0-49d6-b24e-a76f16ef291e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.771784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330db3-90d0-49d6-b24e-a76f16ef291e None admin] RBAC: Adding query filter params (group.id=4bf5a037ff4a4161aa72821fecb84a38, role.id=0048b2f4edbf4a69a99a3d1225c90e18, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:38.772102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330db3-90d0-49d6-b24e-a76f16ef291e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:38.773525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330db3-90d0-49d6-b24e-a76f16ef291e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:38.780359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 218/442] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:38 2022] GET /identity/v3/role_assignments?group.id=4bf5a037ff4a4161aa72821fecb84a38&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=0048b2f4edbf4a69a99a3d1225c90e18 => generated 613 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:38.781188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330db3-90d0-49d6-b24e-a76f16ef291e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:38.816651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 225/443] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:38.817428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc57d1-80af-4aa7-b517-dc081acacc9a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:38.844696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:38.921615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330db3-90d0-49d6-b24e-a76f16ef291e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:38.935468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc57d1-80af-4aa7-b517-dc081acacc9a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:38.961580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:38.965750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509ce22-57a1-45e3-98f7-1c70084e63ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:38.966445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509ce22-57a1-45e3-98f7-1c70084e63ae None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.967172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509ce22-57a1-45e3-98f7-1c70084e63ae None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.967172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509ce22-57a1-45e3-98f7-1c70084e63ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.968433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509ce22-57a1-45e3-98f7-1c70084e63ae None admin] RBAC: Adding query filter params (group.id=4bf5a037ff4a4161aa72821fecb84a38, role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=4148325ec8614e9bbea65c25532b96a0) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:38.968752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509ce22-57a1-45e3-98f7-1c70084e63ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:38.970234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509ce22-57a1-45e3-98f7-1c70084e63ae None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:38.976950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7f2c1-b6a5-4e26-9307-d3d09ed06d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:38.977351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 219/444] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:38 2022] GET /identity/v3/role_assignments?group.id=4bf5a037ff4a4161aa72821fecb84a38&scope.project.id=4148325ec8614e9bbea65c25532b96a0&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 613 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:38.977833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509ce22-57a1-45e3-98f7-1c70084e63ae None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:38.984480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f2c1-b6a5-4e26-9307-d3d09ed06d0f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:38.985130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f2c1-b6a5-4e26-9307-d3d09ed06d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:38.985655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f2c1-b6a5-4e26-9307-d3d09ed06d0f None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:38.986710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7f2c1-b6a5-4e26-9307-d3d09ed06d0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:38.987282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7f2c1-b6a5-4e26-9307-d3d09ed06d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:38.989861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7f2c1-b6a5-4e26-9307-d3d09ed06d0f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:39.003335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 226/445] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:38 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:39.009876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7f2c1-b6a5-4e26-9307-d3d09ed06d0f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:39.128939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509ce22-57a1-45e3-98f7-1c70084e63ae None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:39.131823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:39.154538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7f2c1-b6a5-4e26-9307-d3d09ed06d0f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:39.177569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02588419-fdfc-4994-a985-1e08a048e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:39.178745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02588419-fdfc-4994-a985-1e08a048e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:39.179230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02588419-fdfc-4994-a985-1e08a048e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:39.179680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02588419-fdfc-4994-a985-1e08a048e4d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:39.193202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02588419-fdfc-4994-a985-1e08a048e4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:39.197482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58284703-0393-4358-9aeb-85baf01adae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:39.198133 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58284703-0393-4358-9aeb-85baf01adae5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:39.198422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58284703-0393-4358-9aeb-85baf01adae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:39.198694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58284703-0393-4358-9aeb-85baf01adae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-02588419-fdfc-4994-a985-1e08a048e4d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:39.202629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:39.205707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:39.206532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 220/446] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:39.209869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02588419-fdfc-4994-a985-1e08a048e4d7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:39.281368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:39.303483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58284703-0393-4358-9aeb-85baf01adae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:39.305068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58284703-0393-4358-9aeb-85baf01adae5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:39.333042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02588419-fdfc-4994-a985-1e08a048e4d7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:39.377035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743719d-c51a-4598-b0e5-fb6e4354b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:39.377707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743719d-c51a-4598-b0e5-fb6e4354b619 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:39.377986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743719d-c51a-4598-b0e5-fb6e4354b619 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:39.378257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743719d-c51a-4598-b0e5-fb6e4354b619 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:39.379001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743719d-c51a-4598-b0e5-fb6e4354b619 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:39.379306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743719d-c51a-4598-b0e5-fb6e4354b619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:39.380741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743719d-c51a-4598-b0e5-fb6e4354b619 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:39.391925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 221/447] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:39.398918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743719d-c51a-4598-b0e5-fb6e4354b619 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:39.432840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:39.439087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 227/448] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 16:13:39.445515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58284703-0393-4358-9aeb-85baf01adae5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:39.526732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743719d-c51a-4598-b0e5-fb6e4354b619 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:39.553991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:39.577800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58284703-0393-4358-9aeb-85baf01adae5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:39.579282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319be0-8ced-4957-9820-88c15d6832c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:39.580403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319be0-8ced-4957-9820-88c15d6832c4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:39.580880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319be0-8ced-4957-9820-88c15d6832c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:39.581358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c319be0-8ced-4957-9820-88c15d6832c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:39.624958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616f2b7-71c4-4ff9-991b-d1162b48e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:39.625823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616f2b7-71c4-4ff9-991b-d1162b48e7dd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:39.626100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616f2b7-71c4-4ff9-991b-d1162b48e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:39.626368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616f2b7-71c4-4ff9-991b-d1162b48e7dd None admin] PATH_INFO: `/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:39.627590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616f2b7-71c4-4ff9-991b-d1162b48e7dd None admin] RBAC: Authorizing `identity:get_project(project_id=cda8b9fce6604ccbaa4b14c8377676ca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:39.629042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616f2b7-71c4-4ff9-991b-d1162b48e7dd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:39.630741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 228/449] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:39 2022] GET /identity/v3/projects/cda8b9fce6604ccbaa4b14c8377676ca => generated 303 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:39.636259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616f2b7-71c4-4ff9-991b-d1162b48e7dd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:39.663166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c319be0-8ced-4957-9820-88c15d6832c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:39.664682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c319be0-8ced-4957-9820-88c15d6832c4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:39.691784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:39.738915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616f2b7-71c4-4ff9-991b-d1162b48e7dd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:39.766070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 222/450] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 16:13:39.771947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319be0-8ced-4957-9820-88c15d6832c4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:39.773899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a79e8-2cb3-4e3c-aa94-697dc43357e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:39.774759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a79e8-2cb3-4e3c-aa94-697dc43357e4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:39.775036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a79e8-2cb3-4e3c-aa94-697dc43357e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:39.775305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a79e8-2cb3-4e3c-aa94-697dc43357e4 None admin] PATH_INFO: `/v3/groups/4bf5a037ff4a4161aa72821fecb84a38` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:39.776896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a79e8-2cb3-4e3c-aa94-697dc43357e4 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf5a037ff4a4161aa72821fecb84a38)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:39.778372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a79e8-2cb3-4e3c-aa94-697dc43357e4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:39.785966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 229/451] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:39 2022] GET /identity/v3/groups/4bf5a037ff4a4161aa72821fecb84a38 => generated 227 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:39.787023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a79e8-2cb3-4e3c-aa94-697dc43357e4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:39.809044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:39.874653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c319be0-8ced-4957-9820-88c15d6832c4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:39.890312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a79e8-2cb3-4e3c-aa94-697dc43357e4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:39.900679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:39.910580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a33f-4a4b-4c52-a520-f6c1807f9427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:39.911452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a33f-4a4b-4c52-a520-f6c1807f9427 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:39.911770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a33f-4a4b-4c52-a520-f6c1807f9427 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:39.912049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a33f-4a4b-4c52-a520-f6c1807f9427 None admin] PATH_INFO: `/v3/projects/927da6a6fca54cd4babce7d6546e8b7f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:39.913263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6a33f-4a4b-4c52-a520-f6c1807f9427 None admin] RBAC: Authorizing `identity:get_project(project_id=927da6a6fca54cd4babce7d6546e8b7f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:39.914713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6a33f-4a4b-4c52-a520-f6c1807f9427 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:39.916522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 223/452] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:13:39 2022] GET /identity/v3/projects/927da6a6fca54cd4babce7d6546e8b7f => generated 345 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:39.922630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a33f-4a4b-4c52-a520-f6c1807f9427 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:39.928351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda49f4a-cbbb-4710-93f0-33c523b81336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:39.928351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda49f4a-cbbb-4710-93f0-33c523b81336 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:39.928582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda49f4a-cbbb-4710-93f0-33c523b81336 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:39.928815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda49f4a-cbbb-4710-93f0-33c523b81336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:39.929645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda49f4a-cbbb-4710-93f0-33c523b81336 None admin] RBAC: Adding query filter params (group.id=4bf5a037ff4a4161aa72821fecb84a38, role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:39.929953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda49f4a-cbbb-4710-93f0-33c523b81336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:39.931383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda49f4a-cbbb-4710-93f0-33c523b81336 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:39.938251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 230/453] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:39 2022] GET /identity/v3/role_assignments?group.id=4bf5a037ff4a4161aa72821fecb84a38&scope.project.id=cda8b9fce6604ccbaa4b14c8377676ca&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 613 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:40.037790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a33f-4a4b-4c52-a520-f6c1807f9427 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:40.075860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac106-73d1-4d6d-866b-7cf0e8dbb4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:40.077295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac106-73d1-4d6d-866b-7cf0e8dbb4ac None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:40.077571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac106-73d1-4d6d-866b-7cf0e8dbb4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:40.077841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac106-73d1-4d6d-866b-7cf0e8dbb4ac None admin] PATH_INFO: `/v3/groups/927642f1fbde4189ad1216e647628d5e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:40.079082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac106-73d1-4d6d-866b-7cf0e8dbb4ac None admin] RBAC: Authorizing `identity:get_group(group_id=927642f1fbde4189ad1216e647628d5e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:40.080579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac106-73d1-4d6d-866b-7cf0e8dbb4ac None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:40.082281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 224/454] 10.222.0.112 () {56 vars in 1185 bytes} [Fri Jun 3 16:13:39 2022] GET /identity/v3/groups/927642f1fbde4189ad1216e647628d5e => generated 230 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:40.088476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda49f4a-cbbb-4710-93f0-33c523b81336 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:40.184701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:40.203654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda49f4a-cbbb-4710-93f0-33c523b81336 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:40.242342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985e498-fd7e-4fae-8382-bd1d0c333186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:40.243013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985e498-fd7e-4fae-8382-bd1d0c333186 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:40.243300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985e498-fd7e-4fae-8382-bd1d0c333186 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:40.243604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985e498-fd7e-4fae-8382-bd1d0c333186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:40.244464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985e498-fd7e-4fae-8382-bd1d0c333186 None admin] RBAC: Adding query filter params (group.id=927642f1fbde4189ad1216e647628d5e, role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=927da6a6fca54cd4babce7d6546e8b7f) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:40.244778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985e498-fd7e-4fae-8382-bd1d0c333186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:40.246249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985e498-fd7e-4fae-8382-bd1d0c333186 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:40.254005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 231/455] 10.222.0.112 () {56 vars in 1381 bytes} [Fri Jun 3 16:13:40 2022] GET /identity/v3/role_assignments?group.id=927642f1fbde4189ad1216e647628d5e&scope.project.id=927da6a6fca54cd4babce7d6546e8b7f&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 613 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:43.231740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00e43-335f-44db-b2c2-67c47964b9e7 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:43.233422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00e43-335f-44db-b2c2-67c47964b9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:43.233843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00e43-335f-44db-b2c2-67c47964b9e7 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:43.235719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 225/456] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:43 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:43.241163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cafa9-fadf-4ec5-8ae1-46bc4a0a9a35 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:43.241686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cafa9-fadf-4ec5-8ae1-46bc4a0a9a35 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:43.241945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cafa9-fadf-4ec5-8ae1-46bc4a0a9a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:43.264430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-269cafa9-fadf-4ec5-8ae1-46bc4a0a9a35 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:43.265634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-269cafa9-fadf-4ec5-8ae1-46bc4a0a9a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:43.375266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 232/457] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:43.396362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aac402-4183-4e02-99f2-b50eb0eb6d78 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:43.397005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aac402-4183-4e02-99f2-b50eb0eb6d78 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:43.397510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aac402-4183-4e02-99f2-b50eb0eb6d78 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:43.399406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 226/458] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:43.404410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cafa9-fadf-4ec5-8ae1-46bc4a0a9a35 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:43.417933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68830526-fd96-4284-ad0a-15cb9bf1da25 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:43.418535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68830526-fd96-4284-ad0a-15cb9bf1da25 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:43.419081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68830526-fd96-4284-ad0a-15cb9bf1da25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:43.454616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-68830526-fd96-4284-ad0a-15cb9bf1da25 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:43.456236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-68830526-fd96-4284-ad0a-15cb9bf1da25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:43.571427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:43.594612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 227/459] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:43.661984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:43.671240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68830526-fd96-4284-ad0a-15cb9bf1da25 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:43.683580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cafa9-fadf-4ec5-8ae1-46bc4a0a9a35 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:43.714324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd4e28-4556-49ba-9d94-935d0f3187ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:43.715415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd4e28-4556-49ba-9d94-935d0f3187ad None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:43.715996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd4e28-4556-49ba-9d94-935d0f3187ad None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:43.716445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd4e28-4556-49ba-9d94-935d0f3187ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:43.728606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd4e28-4556-49ba-9d94-935d0f3187ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:43.730360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd4e28-4556-49ba-9d94-935d0f3187ad None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-cacd4e28-4556-49ba-9d94-935d0f3187ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:43.751026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:43.752081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:43.752948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:43.752948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:43.752948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:43.752948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:43.755482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 233/460] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:43.764218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd4e28-4556-49ba-9d94-935d0f3187ad None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:43.872512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68830526-fd96-4284-ad0a-15cb9bf1da25 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:43.914754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4ba4-97bd-43d5-8d98-59ffca8bbdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:43.915980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4ba4-97bd-43d5-8d98-59ffca8bbdca None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:43.916539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4ba4-97bd-43d5-8d98-59ffca8bbdca None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:43.917209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4ba4-97bd-43d5-8d98-59ffca8bbdca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:43.934897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4ba4-97bd-43d5-8d98-59ffca8bbdca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:43.937421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4ba4-97bd-43d5-8d98-59ffca8bbdca None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c63c4ba4-97bd-43d5-8d98-59ffca8bbdca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:43.958964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:43.959990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:43.960858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:43.960858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:43.960858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:43.960858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:43.969037 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 228/461] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:43.970683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4ba4-97bd-43d5-8d98-59ffca8bbdca None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:44.040035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:44.052378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd4e28-4556-49ba-9d94-935d0f3187ad None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:44.087456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:44.096009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce72d9-673f-46f0-871b-51739eb90cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:44.097265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce72d9-673f-46f0-871b-51739eb90cee None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.097734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce72d9-673f-46f0-871b-51739eb90cee None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.098155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce72d9-673f-46f0-871b-51739eb90cee None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.099798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce72d9-673f-46f0-871b-51739eb90cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:44.100293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce72d9-673f-46f0-871b-51739eb90cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:44.102350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce72d9-673f-46f0-871b-51739eb90cee None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:44.112447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4ba4-97bd-43d5-8d98-59ffca8bbdca None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:44.121331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 234/462] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:44.123883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd7377-9bb5-4ad1-b37a-02af3df4818a None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.124463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd7377-9bb5-4ad1-b37a-02af3df4818a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.125412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd7377-9bb5-4ad1-b37a-02af3df4818a None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.128225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 235/463] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:44 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:44.130034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af85b7-7058-4b04-ae87-dc54f303e55d None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.130575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af85b7-7058-4b04-ae87-dc54f303e55d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.131236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af85b7-7058-4b04-ae87-dc54f303e55d None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.133747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 236/464] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:44 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:44.134852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af85b7-7058-4b04-ae87-dc54f303e55d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:44.159397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec90fcc-f445-42f5-a4c7-637b3bdda3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:44.160676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90fcc-f445-42f5-a4c7-637b3bdda3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.161144 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90fcc-f445-42f5-a4c7-637b3bdda3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.161585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90fcc-f445-42f5-a4c7-637b3bdda3c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.162769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec90fcc-f445-42f5-a4c7-637b3bdda3c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:44.163286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec90fcc-f445-42f5-a4c7-637b3bdda3c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:44.164753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec90fcc-f445-42f5-a4c7-637b3bdda3c6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:44.180872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 229/465] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:44.182337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078947d-64bb-4019-9b17-3fcb6443b152 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.182686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078947d-64bb-4019-9b17-3fcb6443b152 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.183027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078947d-64bb-4019-9b17-3fcb6443b152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.201930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d078947d-64bb-4019-9b17-3fcb6443b152 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:44.203157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d078947d-64bb-4019-9b17-3fcb6443b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:44.272532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af85b7-7058-4b04-ae87-dc54f303e55d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:44.288137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 230/466] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:44.289529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c488f-730c-4749-8d46-25069e97169d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.289837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c488f-730c-4749-8d46-25069e97169d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.290097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c488f-730c-4749-8d46-25069e97169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.308077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-957c488f-730c-4749-8d46-25069e97169d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:44.309299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-957c488f-730c-4749-8d46-25069e97169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:44.325601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc426-0bf9-407e-a481-9b0b6158b7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:44.326311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc426-0bf9-407e-a481-9b0b6158b7a0 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.326678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc426-0bf9-407e-a481-9b0b6158b7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.326913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc426-0bf9-407e-a481-9b0b6158b7a0 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.327611 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc426-0bf9-407e-a481-9b0b6158b7a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:44.329071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc426-0bf9-407e-a481-9b0b6158b7a0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:44.351830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:44.363063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 237/467] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:13:44 2022] POST /identity/v3/users => generated 247 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:13:44.372802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc426-0bf9-407e-a481-9b0b6158b7a0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:44.442660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 231/468] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:44.444025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c488f-730c-4749-8d46-25069e97169d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:44.461165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:44.538565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc426-0bf9-407e-a481-9b0b6158b7a0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:44.590902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f74fb-56bf-4882-ae11-05b37218b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:44.591629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f74fb-56bf-4882-ae11-05b37218b5e8 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.592487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f74fb-56bf-4882-ae11-05b37218b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.592735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f74fb-56bf-4882-ae11-05b37218b5e8 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.593471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f74fb-56bf-4882-ae11-05b37218b5e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:44.594658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c488f-730c-4749-8d46-25069e97169d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:44.594970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f74fb-56bf-4882-ae11-05b37218b5e8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:44.627779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 238/469] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:13:44 2022] POST /identity/v3/users => generated 249 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:13:44.629273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f74fb-56bf-4882-ae11-05b37218b5e8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:44.656959 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d37ce3-f978-45cc-9276-a68f8f91211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:44.657636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d37ce3-f978-45cc-9276-a68f8f91211d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.657922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d37ce3-f978-45cc-9276-a68f8f91211d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.658201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d37ce3-f978-45cc-9276-a68f8f91211d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.671462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d37ce3-f978-45cc-9276-a68f8f91211d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:44.673798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d37ce3-f978-45cc-9276-a68f8f91211d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c9d37ce3-f978-45cc-9276-a68f8f91211d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:44.695578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:44.696543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:44.697441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:44.697441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:44.697441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:44.697441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:44.699876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 232/470] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:44.708672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d37ce3-f978-45cc-9276-a68f8f91211d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:44.736601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:44.786182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f74fb-56bf-4882-ae11-05b37218b5e8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:44.789657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:44.828513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c3176-7506-4dce-bebb-91db91be8a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:44.829228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c3176-7506-4dce-bebb-91db91be8a5d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.829615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c3176-7506-4dce-bebb-91db91be8a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.829958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c3176-7506-4dce-bebb-91db91be8a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.842805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c3176-7506-4dce-bebb-91db91be8a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:44.844484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c3176-7506-4dce-bebb-91db91be8a5d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-a98c3176-7506-4dce-bebb-91db91be8a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:44.868736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:44.869672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:44.870551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:44.870551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:44.870551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:44.870551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:44.875836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 239/471] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:44.877409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39fdc6-dae8-4916-bc1e-72feb64eded9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.877698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39fdc6-dae8-4916-bc1e-72feb64eded9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.877976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39fdc6-dae8-4916-bc1e-72feb64eded9 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.879513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 240/472] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:44.883711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39fdc6-dae8-4916-bc1e-72feb64eded9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:44.894444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d37ce3-f978-45cc-9276-a68f8f91211d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:44.946489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341251a-d55a-4a89-90e4-83df43a4210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:44.947704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341251a-d55a-4a89-90e4-83df43a4210b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.948137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341251a-d55a-4a89-90e4-83df43a4210b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.948717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341251a-d55a-4a89-90e4-83df43a4210b None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.949628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341251a-d55a-4a89-90e4-83df43a4210b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:44.950438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341251a-d55a-4a89-90e4-83df43a4210b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:44.952093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341251a-d55a-4a89-90e4-83df43a4210b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:44.968431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 233/473] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:44.970017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969db169-1c6b-4449-a7d1-f63f004c9442 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:44.970485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969db169-1c6b-4449-a7d1-f63f004c9442 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:44.970906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969db169-1c6b-4449-a7d1-f63f004c9442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:44.992779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-969db169-1c6b-4449-a7d1-f63f004c9442 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:44.994331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-969db169-1c6b-4449-a7d1-f63f004c9442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:45.018927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39fdc6-dae8-4916-bc1e-72feb64eded9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:45.084663 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681f50-e30f-4c5b-8327-2d7d362bc491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:45.085280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 234/474] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:45.085921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681f50-e30f-4c5b-8327-2d7d362bc491 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:45.086426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681f50-e30f-4c5b-8327-2d7d362bc491 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:45.087238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681f50-e30f-4c5b-8327-2d7d362bc491 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:45.088756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681f50-e30f-4c5b-8327-2d7d362bc491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:45.089331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681f50-e30f-4c5b-8327-2d7d362bc491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:45.091235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969db169-1c6b-4449-a7d1-f63f004c9442 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:45.092748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681f50-e30f-4c5b-8327-2d7d362bc491 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:45.108912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:45.117153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 241/475] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:45.123641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681f50-e30f-4c5b-8327-2d7d362bc491 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:45.146327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:45.225434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969db169-1c6b-4449-a7d1-f63f004c9442 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:45.267313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe64f0-48aa-4010-9c36-7e64cfa4931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:45.268011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe64f0-48aa-4010-9c36-7e64cfa4931f None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:45.268290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe64f0-48aa-4010-9c36-7e64cfa4931f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:45.268564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe64f0-48aa-4010-9c36-7e64cfa4931f None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:45.269275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe64f0-48aa-4010-9c36-7e64cfa4931f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:45.270715 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe64f0-48aa-4010-9c36-7e64cfa4931f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:45.275681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681f50-e30f-4c5b-8327-2d7d362bc491 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:45.299357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 235/476] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:13:45 2022] POST /identity/v3/users => generated 250 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:13:45.300290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe64f0-48aa-4010-9c36-7e64cfa4931f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:45.317463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee5fc0-ef06-4379-8894-fdc632a0efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:45.318153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee5fc0-ef06-4379-8894-fdc632a0efc2 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:45.318581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee5fc0-ef06-4379-8894-fdc632a0efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:45.318865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee5fc0-ef06-4379-8894-fdc632a0efc2 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:45.319794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee5fc0-ef06-4379-8894-fdc632a0efc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:45.321375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee5fc0-ef06-4379-8894-fdc632a0efc2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:45.351761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 242/477] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:13:45 2022] POST /identity/v3/users => generated 249 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:13:45.382969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:45.443840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe64f0-48aa-4010-9c36-7e64cfa4931f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:45.489841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:45.490527 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:45.490804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:45.491076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:45.491878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:45.493373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:45.502921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.sql.core [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 16:13:45.502921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 16:13:45.502921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [parameters: {'id': '7f14aa2163554c2fb7f168d251b72562', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 16:13:45.502921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80222) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application conn.query(q) Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application result.read() Jun 03 16:13:45.523279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return ref.to_dict() Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 16:13:45.525320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application next(self.gen) Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application yield resource Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application next(self.gen) Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise self.value Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application session.commit() Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 16:13:45.526493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.session.flush() Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application compat.raise_( Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 16:13:45.527742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 16:13:45.528854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application conn.query(q) Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application result.read() Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 16:13:45.529994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [parameters: {'id': '7f14aa2163554c2fb7f168d251b72562', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:45.533846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 16:13:45.540216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:45.541255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 236/478] 10.222.0.112 () {60 vars in 1136 bytes} [Fri Jun 3 16:13:45 2022] POST /identity/v3/roles => generated 144 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:45.541335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee5fc0-ef06-4379-8894-fdc632a0efc2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:45.680781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:45.723983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee5fc0-ef06-4379-8894-fdc632a0efc2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:45.763084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904eaec-f2b8-40d5-af21-f4eaefd9c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:45.764814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904eaec-f2b8-40d5-af21-f4eaefd9c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:45.765245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904eaec-f2b8-40d5-af21-f4eaefd9c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:45.765659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904eaec-f2b8-40d5-af21-f4eaefd9c5c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:45.778091 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904eaec-f2b8-40d5-af21-f4eaefd9c5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-2904eaec-f2b8-40d5-af21-f4eaefd9c5c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:45.786584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:45.787640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 16:13:45.788456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:45.789087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 243/479] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:13:45.794503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:46.045757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d0231-ef2f-435d-b5f8-d7a06df83ee1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:46.074290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:46.091416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdf7f6-2bd8-448d-a48a-ec1a2242134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:46.093050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf7f6-2bd8-448d-a48a-ec1a2242134e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:46.093521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf7f6-2bd8-448d-a48a-ec1a2242134e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:46.093981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdf7f6-2bd8-448d-a48a-ec1a2242134e None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:46.094974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf7f6-2bd8-448d-a48a-ec1a2242134e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:46.095498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf7f6-2bd8-448d-a48a-ec1a2242134e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:46.097179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdf7f6-2bd8-448d-a48a-ec1a2242134e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:46.116472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 237/480] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:45 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:47.476790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceddbc-c38a-4362-a181-2ad9c2b9a367 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:47.477348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceddbc-c38a-4362-a181-2ad9c2b9a367 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:47.477348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceddbc-c38a-4362-a181-2ad9c2b9a367 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:47.478975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 244/481] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:47.493468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1d5e-54c2-4e68-956a-cebad3936e6a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:47.493985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1d5e-54c2-4e68-956a-cebad3936e6a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:47.494267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1d5e-54c2-4e68-956a-cebad3936e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:47.496721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff284b6-0da4-40c4-ad66-e4664b2dd075 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:47.497245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff284b6-0da4-40c4-ad66-e4664b2dd075 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:47.497727 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff284b6-0da4-40c4-ad66-e4664b2dd075 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:47.499655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 245/482] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:47.505693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17000f94-b4f9-41c4-a589-dcac81d9d2cd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:47.506423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17000f94-b4f9-41c4-a589-dcac81d9d2cd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:47.506907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17000f94-b4f9-41c4-a589-dcac81d9d2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:47.525661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0ffa1d5e-54c2-4e68-956a-cebad3936e6a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:47.527307 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0ffa1d5e-54c2-4e68-956a-cebad3936e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:47.528918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-17000f94-b4f9-41c4-a589-dcac81d9d2cd None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:47.531205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-17000f94-b4f9-41c4-a589-dcac81d9d2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:47.670791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 238/483] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:47.699889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 246/484] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:13:47.713252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1d5e-54c2-4e68-956a-cebad3936e6a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:47.746201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17000f94-b4f9-41c4-a589-dcac81d9d2cd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:47.847937 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:47.908728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17000f94-b4f9-41c4-a589-dcac81d9d2cd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:47.987217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1d5e-54c2-4e68-956a-cebad3936e6a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:48.021228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7bfd8-9a93-4b91-99c2-70dfb33496c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:48.021955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7bfd8-9a93-4b91-99c2-70dfb33496c6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.022237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7bfd8-9a93-4b91-99c2-70dfb33496c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.022511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7bfd8-9a93-4b91-99c2-70dfb33496c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.031785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:48.064650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7bfd8-9a93-4b91-99c2-70dfb33496c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-05f7bfd8-9a93-4b91-99c2-70dfb33496c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:48.075290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:48.077153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:48.078268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:48.080808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a70e55-9e7b-4a02-93c1-86d2b096436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:48.081665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a70e55-9e7b-4a02-93c1-86d2b096436c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.081953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a70e55-9e7b-4a02-93c1-86d2b096436c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.082237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a70e55-9e7b-4a02-93c1-86d2b096436c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.082958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 247/485] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:13:48.090827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7bfd8-9a93-4b91-99c2-70dfb33496c6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:48.110215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a70e55-9e7b-4a02-93c1-86d2b096436c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d6a70e55-9e7b-4a02-93c1-86d2b096436c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:48.118911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:48.120034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:48.120863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 239/486] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:48.127207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a70e55-9e7b-4a02-93c1-86d2b096436c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:48.224712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7bfd8-9a93-4b91-99c2-70dfb33496c6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:48.253864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:48.268762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f31b47-ff80-4ca8-8dde-c050859d4b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:48.269988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f31b47-ff80-4ca8-8dde-c050859d4b21 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.270625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f31b47-ff80-4ca8-8dde-c050859d4b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.271378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f31b47-ff80-4ca8-8dde-c050859d4b21 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.273071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f31b47-ff80-4ca8-8dde-c050859d4b21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:48.273688 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f31b47-ff80-4ca8-8dde-c050859d4b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:48.275360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f31b47-ff80-4ca8-8dde-c050859d4b21 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:48.289131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 248/487] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:13:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:48.299116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f31b47-ff80-4ca8-8dde-c050859d4b21 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:48.406356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a70e55-9e7b-4a02-93c1-86d2b096436c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:48.459173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9231-5268-4168-ab4d-3adb7f69723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:48.460792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9231-5268-4168-ab4d-3adb7f69723d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.461544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9231-5268-4168-ab4d-3adb7f69723d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.462330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9231-5268-4168-ab4d-3adb7f69723d None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.464805 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd9231-5268-4168-ab4d-3adb7f69723d None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:48.465774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd9231-5268-4168-ab4d-3adb7f69723d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:48.470537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd9231-5268-4168-ab4d-3adb7f69723d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:48.494707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 240/488] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:13:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:48.496858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f31b47-ff80-4ca8-8dde-c050859d4b21 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:48.500622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec22fd-5b03-4f66-bbe7-746bdbe55735 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.501311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec22fd-5b03-4f66-bbe7-746bdbe55735 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.501912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec22fd-5b03-4f66-bbe7-746bdbe55735 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.504837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 241/489] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:48 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:48.508800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2e560-6e80-4637-a922-464748619a81 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.508800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2e560-6e80-4637-a922-464748619a81 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.508800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2e560-6e80-4637-a922-464748619a81 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.510951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 242/490] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:48 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:48.512800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2e560-6e80-4637-a922-464748619a81 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:48.539083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb4717-209f-47f9-934a-ab915edfcd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:48.539847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb4717-209f-47f9-934a-ab915edfcd1b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.540126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb4717-209f-47f9-934a-ab915edfcd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.540398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb4717-209f-47f9-934a-ab915edfcd1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.553018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb4717-209f-47f9-934a-ab915edfcd1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:48.554513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb4717-209f-47f9-934a-ab915edfcd1b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-9dfb4717-209f-47f9-934a-ab915edfcd1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:48.573652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:48.574599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:48.575519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:48.575519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:48.575519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:48.575519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:48.575519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 249/491] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:48.576792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6ec0-c0e1-47fd-8164-67dacfe01213 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.577078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6ec0-c0e1-47fd-8164-67dacfe01213 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.577352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6ec0-c0e1-47fd-8164-67dacfe01213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.597265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:48.600768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fa5d6ec0-c0e1-47fd-8164-67dacfe01213 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:48.603139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fa5d6ec0-c0e1-47fd-8164-67dacfe01213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:48.642769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:48.705320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2e560-6e80-4637-a922-464748619a81 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:48.727836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 250/492] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:48.731648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394eb19-917e-4eba-992c-cd082c620fd4 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.733575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394eb19-917e-4eba-992c-cd082c620fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.734300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394eb19-917e-4eba-992c-cd082c620fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.749704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596432-2411-47ba-b0af-ea3e5940ab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:48.750679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596432-2411-47ba-b0af-ea3e5940ab34 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:48.751046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596432-2411-47ba-b0af-ea3e5940ab34 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:48.752616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596432-2411-47ba-b0af-ea3e5940ab34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:48.763890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f596432-2411-47ba-b0af-ea3e5940ab34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:48.765377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f596432-2411-47ba-b0af-ea3e5940ab34 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:48.766668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0394eb19-917e-4eba-992c-cd082c620fd4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:48.767908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0394eb19-917e-4eba-992c-cd082c620fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9f596432-2411-47ba-b0af-ea3e5940ab34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:48.786590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:48.788474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:48.790544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:48.790544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:48.790544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:48.790544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:48.790544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 243/493] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:48.790544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596432-2411-47ba-b0af-ea3e5940ab34 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:48.858512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 251/494] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:48.859283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394eb19-917e-4eba-992c-cd082c620fd4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:48.945083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:48.961846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596432-2411-47ba-b0af-ea3e5940ab34 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:49.009148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:49.011183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89f729-4196-41bb-98f3-b221364ec518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:49.011999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89f729-4196-41bb-98f3-b221364ec518 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.012358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89f729-4196-41bb-98f3-b221364ec518 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.012629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89f729-4196-41bb-98f3-b221364ec518 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.013402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89f729-4196-41bb-98f3-b221364ec518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:49.014255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89f729-4196-41bb-98f3-b221364ec518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:49.015732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89f729-4196-41bb-98f3-b221364ec518 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:49.021195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394eb19-917e-4eba-992c-cd082c620fd4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:49.029876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 244/495] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:49.030758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89f729-4196-41bb-98f3-b221364ec518 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:49.071285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3844-b694-4a03-9c09-aba93497b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:49.072441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3844-b694-4a03-9c09-aba93497b476 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.072911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3844-b694-4a03-9c09-aba93497b476 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.073397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3844-b694-4a03-9c09-aba93497b476 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.086685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a3844-b694-4a03-9c09-aba93497b476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-aa2a3844-b694-4a03-9c09-aba93497b476 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:49.094923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:49.096673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 252/496] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:49.098158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3844-b694-4a03-9c09-aba93497b476 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:49.204146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89f729-4196-41bb-98f3-b221364ec518 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:49.240368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3844-b694-4a03-9c09-aba93497b476 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:49.252764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdffe99-b823-4bd2-8ce4-2a6b31465a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:49.253435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdffe99-b823-4bd2-8ce4-2a6b31465a71 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.253720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdffe99-b823-4bd2-8ce4-2a6b31465a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.253995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdffe99-b823-4bd2-8ce4-2a6b31465a71 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.254721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdffe99-b823-4bd2-8ce4-2a6b31465a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:49.255033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdffe99-b823-4bd2-8ce4-2a6b31465a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:49.256460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdffe99-b823-4bd2-8ce4-2a6b31465a71 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:49.269602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 245/497] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:49.270508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdffe99-b823-4bd2-8ce4-2a6b31465a71 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:49.283750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943cdef-83e1-4f17-877d-c30a897ed0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:49.285132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943cdef-83e1-4f17-877d-c30a897ed0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.285640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943cdef-83e1-4f17-877d-c30a897ed0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.286137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943cdef-83e1-4f17-877d-c30a897ed0a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.294036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:49.303590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943cdef-83e1-4f17-877d-c30a897ed0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5943cdef-83e1-4f17-877d-c30a897ed0a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:49.312054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:49.313155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:49.313958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 253/498] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:49.314609 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943cdef-83e1-4f17-877d-c30a897ed0a0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:49.331394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:49.399358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdffe99-b823-4bd2-8ce4-2a6b31465a71 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:49.438819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c8af7-351f-45eb-8412-ac66e090ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:49.439659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c8af7-351f-45eb-8412-ac66e090ad1c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.439951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c8af7-351f-45eb-8412-ac66e090ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.440204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943cdef-83e1-4f17-877d-c30a897ed0a0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:49.440316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c8af7-351f-45eb-8412-ac66e090ad1c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.449939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c8af7-351f-45eb-8412-ac66e090ad1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:49.450770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c8af7-351f-45eb-8412-ac66e090ad1c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-093c8af7-351f-45eb-8412-ac66e090ad1c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:13:49.469284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:49.471206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 246/499] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad40f0a-4aa9-4057-b0a8-4041b8aa8b03 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.473010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad40f0a-4aa9-4057-b0a8-4041b8aa8b03 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.474085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad40f0a-4aa9-4057-b0a8-4041b8aa8b03 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.478114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 247/500] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:49 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:49.479104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad40f0a-4aa9-4057-b0a8-4041b8aa8b03 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:49.484449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961583b-75c0-47b0-ab2d-2121714c37d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:49.485135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961583b-75c0-47b0-ab2d-2121714c37d6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.485418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961583b-75c0-47b0-ab2d-2121714c37d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.485693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961583b-75c0-47b0-ab2d-2121714c37d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.486473 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961583b-75c0-47b0-ab2d-2121714c37d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:49.486780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961583b-75c0-47b0-ab2d-2121714c37d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:49.488331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961583b-75c0-47b0-ab2d-2121714c37d6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:49.497555 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 254/501] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:13:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:49.499219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961583b-75c0-47b0-ab2d-2121714c37d6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:49.567611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:49.593574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:49.615103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad40f0a-4aa9-4057-b0a8-4041b8aa8b03 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:49.619430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961583b-75c0-47b0-ab2d-2121714c37d6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:49.656943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06f160-4ff6-4403-8ad8-3ad02c58261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:49.657613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f160-4ff6-4403-8ad8-3ad02c58261d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.657893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f160-4ff6-4403-8ad8-3ad02c58261d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.658163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f160-4ff6-4403-8ad8-3ad02c58261d None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.658916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f160-4ff6-4403-8ad8-3ad02c58261d None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:49.659216 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f160-4ff6-4403-8ad8-3ad02c58261d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:49.660652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f160-4ff6-4403-8ad8-3ad02c58261d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:49.670748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 255/502] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:13:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:49.672012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06f160-4ff6-4403-8ad8-3ad02c58261d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:49.681828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3968a64-3e47-4c76-919b-59adfa122dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:49.682652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3968a64-3e47-4c76-919b-59adfa122dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.682942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3968a64-3e47-4c76-919b-59adfa122dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.683210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3968a64-3e47-4c76-919b-59adfa122dd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.691974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3968a64-3e47-4c76-919b-59adfa122dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:49.693469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3968a64-3e47-4c76-919b-59adfa122dd4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b3968a64-3e47-4c76-919b-59adfa122dd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:13:49.710346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:49.712325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 248/503] 10.222.0.112 () {56 vars in 1098 bytes} [Fri Jun 3 16:13:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0813fd-da03-40a9-bfa6-498cbc04f3cf None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.713742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0813fd-da03-40a9-bfa6-498cbc04f3cf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.714837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0813fd-da03-40a9-bfa6-498cbc04f3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.740910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0f0813fd-da03-40a9-bfa6-498cbc04f3cf None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:49.742866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0f0813fd-da03-40a9-bfa6-498cbc04f3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:49.800527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06f160-4ff6-4403-8ad8-3ad02c58261d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:49.838027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355bf53-7705-4c1f-a24c-ae9ef3c8fa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:49.838684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355bf53-7705-4c1f-a24c-ae9ef3c8fa4d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:49.838963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355bf53-7705-4c1f-a24c-ae9ef3c8fa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:49.839234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355bf53-7705-4c1f-a24c-ae9ef3c8fa4d None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:49.840124 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355bf53-7705-4c1f-a24c-ae9ef3c8fa4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:49.840435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355bf53-7705-4c1f-a24c-ae9ef3c8fa4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:49.841967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355bf53-7705-4c1f-a24c-ae9ef3c8fa4d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:49.847985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 249/504] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:49.849448 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0813fd-da03-40a9-bfa6-498cbc04f3cf None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:49.863851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:49.890988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 256/505] 10.222.0.112 () {56 vars in 1142 bytes} [Fri Jun 3 16:13:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:49.894205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355bf53-7705-4c1f-a24c-ae9ef3c8fa4d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:49.946040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:49.994857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0813fd-da03-40a9-bfa6-498cbc04f3cf None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:50.031347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355bf53-7705-4c1f-a24c-ae9ef3c8fa4d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:50.034886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9674a0-60ec-4bfc-8052-0135b26f2d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:50.035728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9674a0-60ec-4bfc-8052-0135b26f2d20 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:50.036012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9674a0-60ec-4bfc-8052-0135b26f2d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:50.036284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9674a0-60ec-4bfc-8052-0135b26f2d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:50.048286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9674a0-60ec-4bfc-8052-0135b26f2d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:50.050188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9674a0-60ec-4bfc-8052-0135b26f2d20 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5d9674a0-60ec-4bfc-8052-0135b26f2d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:50.069210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:50.070305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:50.071900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:50.071900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:50.071900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:50.071900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:50.071900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 250/506] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:50.071900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9674a0-60ec-4bfc-8052-0135b26f2d20 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:50.086975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64988ce0-7f12-4771-b356-682499eabed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:50.094044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64988ce0-7f12-4771-b356-682499eabed0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:50.094359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64988ce0-7f12-4771-b356-682499eabed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:50.094638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64988ce0-7f12-4771-b356-682499eabed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:50.109197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64988ce0-7f12-4771-b356-682499eabed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:50.110863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64988ce0-7f12-4771-b356-682499eabed0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-64988ce0-7f12-4771-b356-682499eabed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:50.132836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:50.133978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:50.135178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:50.135178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:50.135178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:50.135178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:50.135178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 257/507] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:50.136254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64988ce0-7f12-4771-b356-682499eabed0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:50.194035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:50.196287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9674a0-60ec-4bfc-8052-0135b26f2d20 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:50.213700 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:50.241969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad209da-4da6-423a-9257-5c59f6d9424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:50.243113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad209da-4da6-423a-9257-5c59f6d9424b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:50.243534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad209da-4da6-423a-9257-5c59f6d9424b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:50.244028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad209da-4da6-423a-9257-5c59f6d9424b None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:50.245706 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad209da-4da6-423a-9257-5c59f6d9424b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:50.246277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad209da-4da6-423a-9257-5c59f6d9424b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:50.249652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad209da-4da6-423a-9257-5c59f6d9424b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:50.258905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64988ce0-7f12-4771-b356-682499eabed0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:50.297025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526b088-ea5d-4b77-9ea0-aad6a4cb0105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:50.297839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526b088-ea5d-4b77-9ea0-aad6a4cb0105 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:50.298143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526b088-ea5d-4b77-9ea0-aad6a4cb0105 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:50.298413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526b088-ea5d-4b77-9ea0-aad6a4cb0105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:50.310837 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526b088-ea5d-4b77-9ea0-aad6a4cb0105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:50.312352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526b088-ea5d-4b77-9ea0-aad6a4cb0105 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:50.321376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 251/508] 10.222.0.112 () {56 vars in 1138 bytes} [Fri Jun 3 16:13:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:50.322752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad209da-4da6-423a-9257-5c59f6d9424b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-8526b088-ea5d-4b77-9ea0-aad6a4cb0105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:50.331236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:50.333011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:50.334847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:50.334847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:50.334847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:50.334847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:50.337551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 258/509] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:50.338464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526b088-ea5d-4b77-9ea0-aad6a4cb0105 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:50.463828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:50.468412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526b088-ea5d-4b77-9ea0-aad6a4cb0105 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:50.473008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad209da-4da6-423a-9257-5c59f6d9424b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:50.507844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf7b25-3d13-4808-aa93-bc60577e1134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:50.508516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf7b25-3d13-4808-aa93-bc60577e1134 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:50.508804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf7b25-3d13-4808-aa93-bc60577e1134 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:50.509083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf7b25-3d13-4808-aa93-bc60577e1134 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:50.509191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81cdef-dbfd-4714-9ffa-9afebdce65ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:50.509790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81cdef-dbfd-4714-9ffa-9afebdce65ab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:50.509901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf7b25-3d13-4808-aa93-bc60577e1134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:50.510070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81cdef-dbfd-4714-9ffa-9afebdce65ab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:50.510185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf7b25-3d13-4808-aa93-bc60577e1134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:50.510341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81cdef-dbfd-4714-9ffa-9afebdce65ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:50.511501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf7b25-3d13-4808-aa93-bc60577e1134 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:50.530031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 259/510] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:50.531591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf7b25-3d13-4808-aa93-bc60577e1134 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:50.559717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:50.592955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81cdef-dbfd-4714-9ffa-9afebdce65ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:50.594447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81cdef-dbfd-4714-9ffa-9afebdce65ab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:50.670829 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf7b25-3d13-4808-aa93-bc60577e1134 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:50.710392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 252/511] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:50.711916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81cdef-dbfd-4714-9ffa-9afebdce65ab None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:50.718356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36617be-1eb5-44a7-9305-4361a41bfe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:50.719102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36617be-1eb5-44a7-9305-4361a41bfe6a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:50.719503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36617be-1eb5-44a7-9305-4361a41bfe6a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:50.719927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36617be-1eb5-44a7-9305-4361a41bfe6a None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:50.720818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36617be-1eb5-44a7-9305-4361a41bfe6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:50.721219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36617be-1eb5-44a7-9305-4361a41bfe6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:50.722748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36617be-1eb5-44a7-9305-4361a41bfe6a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:50.739316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 260/512] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:50.740417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36617be-1eb5-44a7-9305-4361a41bfe6a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:50.769297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:50.803828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:50.837854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81cdef-dbfd-4714-9ffa-9afebdce65ab None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:50.877694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b487ec-420f-48c2-96e0-dbbb0902ad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:50.878445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b487ec-420f-48c2-96e0-dbbb0902ad41 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:50.878851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b487ec-420f-48c2-96e0-dbbb0902ad41 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:50.879253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b487ec-420f-48c2-96e0-dbbb0902ad41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:50.885969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36617be-1eb5-44a7-9305-4361a41bfe6a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:50.929274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a09c-be12-4352-b0e8-18035a1442fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:50.929938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a09c-be12-4352-b0e8-18035a1442fc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:50.930217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a09c-be12-4352-b0e8-18035a1442fc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:50.930487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a09c-be12-4352-b0e8-18035a1442fc None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:50.931226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06a09c-be12-4352-b0e8-18035a1442fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:50.931530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06a09c-be12-4352-b0e8-18035a1442fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:50.933001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06a09c-be12-4352-b0e8-18035a1442fc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:50.946345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 261/513] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:50.947234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a09c-be12-4352-b0e8-18035a1442fc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:50.981612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b487ec-420f-48c2-96e0-dbbb0902ad41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:50.983270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b487ec-420f-48c2-96e0-dbbb0902ad41 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:51.048183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:51.060096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:51.069711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a09c-be12-4352-b0e8-18035a1442fc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:51.093645 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 253/514] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:51.094501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b487ec-420f-48c2-96e0-dbbb0902ad41 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:51.112878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e4565-60d5-43f0-8d79-bb4dc048080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:51.113744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4565-60d5-43f0-8d79-bb4dc048080a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:51.114453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4565-60d5-43f0-8d79-bb4dc048080a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:51.114753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4565-60d5-43f0-8d79-bb4dc048080a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:51.123363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e4565-60d5-43f0-8d79-bb4dc048080a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:51.124886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e4565-60d5-43f0-8d79-bb4dc048080a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-0b8e4565-60d5-43f0-8d79-bb4dc048080a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:13:51.142571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:51.143788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:51.144725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 262/515] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:51.145299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e4565-60d5-43f0-8d79-bb4dc048080a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:51.204655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b487ec-420f-48c2-96e0-dbbb0902ad41 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:51.242929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02e15-44ca-4f20-927d-bd150c7c7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:51.244237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02e15-44ca-4f20-927d-bd150c7c7b1a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:51.244754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02e15-44ca-4f20-927d-bd150c7c7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:51.245267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02e15-44ca-4f20-927d-bd150c7c7b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:51.257842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e4565-60d5-43f0-8d79-bb4dc048080a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:51.258918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db02e15-44ca-4f20-927d-bd150c7c7b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:51.260425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db02e15-44ca-4f20-927d-bd150c7c7b1a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-6db02e15-44ca-4f20-927d-bd150c7c7b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:51.280067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:51.281209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:51.282149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:51.282149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:51.282149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:51.282149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:51.282149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 254/516] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:51.282149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02e15-44ca-4f20-927d-bd150c7c7b1a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:51.297030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac70201-af5c-43fe-b8f1-ac7f94196fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:51.297934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac70201-af5c-43fe-b8f1-ac7f94196fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:51.298220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac70201-af5c-43fe-b8f1-ac7f94196fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:51.298496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac70201-af5c-43fe-b8f1-ac7f94196fa6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:51.305975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac70201-af5c-43fe-b8f1-ac7f94196fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:51.307436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac70201-af5c-43fe-b8f1-ac7f94196fa6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:51.309437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:51.311290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-aac70201-af5c-43fe-b8f1-ac7f94196fa6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:13:51.325214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:51.326810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 263/517] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:51.327922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac70201-af5c-43fe-b8f1-ac7f94196fa6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:51.406508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02e15-44ca-4f20-927d-bd150c7c7b1a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:51.449914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a313-a849-4faa-a30e-4c9ccfa2becc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:51.450581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a313-a849-4faa-a30e-4c9ccfa2becc None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:51.450899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a313-a849-4faa-a30e-4c9ccfa2becc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:51.451172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a313-a849-4faa-a30e-4c9ccfa2becc None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:51.451323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac70201-af5c-43fe-b8f1-ac7f94196fa6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:51.452055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052a313-a849-4faa-a30e-4c9ccfa2becc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:51.453505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052a313-a849-4faa-a30e-4c9ccfa2becc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:51.481408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 255/518] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:13:51 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:13:51.483381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a313-a849-4faa-a30e-4c9ccfa2becc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:51.500296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6717e8a-e8f8-4341-9ff0-b1abd6076cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:51.501294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6717e8a-e8f8-4341-9ff0-b1abd6076cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:51.501591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6717e8a-e8f8-4341-9ff0-b1abd6076cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:51.501880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6717e8a-e8f8-4341-9ff0-b1abd6076cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:51.519478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6717e8a-e8f8-4341-9ff0-b1abd6076cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:51.521057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6717e8a-e8f8-4341-9ff0-b1abd6076cb8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d6717e8a-e8f8-4341-9ff0-b1abd6076cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:51.542256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:51.544061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:51.545803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:51.545803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:51.545803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:51.545803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:51.545803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 264/519] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:51.545803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6717e8a-e8f8-4341-9ff0-b1abd6076cb8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:51.646530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:51.652230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:51.682505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a313-a849-4faa-a30e-4c9ccfa2becc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:51.731589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe6735-9902-4647-a644-ae80566bf0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:51.732652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6735-9902-4647-a644-ae80566bf0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:51.732999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6735-9902-4647-a644-ae80566bf0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:51.733286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6735-9902-4647-a644-ae80566bf0c5 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:51.734152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe6735-9902-4647-a644-ae80566bf0c5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:51.734467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe6735-9902-4647-a644-ae80566bf0c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:51.735983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe6735-9902-4647-a644-ae80566bf0c5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:51.740284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6717e8a-e8f8-4341-9ff0-b1abd6076cb8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:51.761644 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 256/520] 10.222.0.112 () {56 vars in 1144 bytes} [Fri Jun 3 16:13:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:51.762576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe6735-9902-4647-a644-ae80566bf0c5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:51.786344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1836b70-828a-45c5-8471-f8ca953d16d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:51.787348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1836b70-828a-45c5-8471-f8ca953d16d0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:51.787665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1836b70-828a-45c5-8471-f8ca953d16d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:51.787943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1836b70-828a-45c5-8471-f8ca953d16d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:51.788682 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1836b70-828a-45c5-8471-f8ca953d16d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:51.788989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1836b70-828a-45c5-8471-f8ca953d16d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:51.790406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1836b70-828a-45c5-8471-f8ca953d16d0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:51.803455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 265/521] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:51.805068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1836b70-828a-45c5-8471-f8ca953d16d0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:51.893498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe6735-9902-4647-a644-ae80566bf0c5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:51.932781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1836b70-828a-45c5-8471-f8ca953d16d0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:51.934638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c59ec-cd91-4613-b853-3c7a4b0191b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:51.935891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c59ec-cd91-4613-b853-3c7a4b0191b5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:51.937035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c59ec-cd91-4613-b853-3c7a4b0191b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:51.937035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c59ec-cd91-4613-b853-3c7a4b0191b5 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:51.937305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c59ec-cd91-4613-b853-3c7a4b0191b5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:51.937619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c59ec-cd91-4613-b853-3c7a4b0191b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:51.939126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c59ec-cd91-4613-b853-3c7a4b0191b5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:51.948649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:51.952732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:51.967383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 257/522] 10.222.0.112 () {56 vars in 1142 bytes} [Fri Jun 3 16:13:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:51.968408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c59ec-cd91-4613-b853-3c7a4b0191b5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:51.985692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f1c84-8b42-443e-b21f-d9830a3d89d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:51.986384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1c84-8b42-443e-b21f-d9830a3d89d8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:51.986671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1c84-8b42-443e-b21f-d9830a3d89d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:51.986952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1c84-8b42-443e-b21f-d9830a3d89d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:51.987852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f1c84-8b42-443e-b21f-d9830a3d89d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:51.988161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f1c84-8b42-443e-b21f-d9830a3d89d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:51.989616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f1c84-8b42-443e-b21f-d9830a3d89d8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:52.004253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 266/523] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:52.004928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f1c84-8b42-443e-b21f-d9830a3d89d8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:52.131027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c59ec-cd91-4613-b853-3c7a4b0191b5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:52.166974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f1c84-8b42-443e-b21f-d9830a3d89d8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:52.184982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c9622-662b-46dd-bd83-3afdb6373acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:52.186276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c9622-662b-46dd-bd83-3afdb6373acc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:52.186564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c9622-662b-46dd-bd83-3afdb6373acc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:52.186838 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c9622-662b-46dd-bd83-3afdb6373acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:52.213324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd183a-76c4-4249-b086-a1fd1910fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:52.214179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd183a-76c4-4249-b086-a1fd1910fce0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:52.214462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd183a-76c4-4249-b086-a1fd1910fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:52.214741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd183a-76c4-4249-b086-a1fd1910fce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:52.223749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd183a-76c4-4249-b086-a1fd1910fce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:52.225304 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd183a-76c4-4249-b086-a1fd1910fce0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-a8bd183a-76c4-4249-b086-a1fd1910fce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:13:52.242024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:52.243449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 267/524] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:52.244423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd183a-76c4-4249-b086-a1fd1910fce0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:52.279096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:52.287672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c9622-662b-46dd-bd83-3afdb6373acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:52.289349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c9622-662b-46dd-bd83-3afdb6373acc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:52.295584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:52.400617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd183a-76c4-4249-b086-a1fd1910fce0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:52.419707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 258/525] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:52.422279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c9622-662b-46dd-bd83-3afdb6373acc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:52.457911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccb511-8f59-42e6-98c6-ab9bf7ffd62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:52.458679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccb511-8f59-42e6-98c6-ab9bf7ffd62b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:52.458965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccb511-8f59-42e6-98c6-ab9bf7ffd62b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:52.459242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccb511-8f59-42e6-98c6-ab9bf7ffd62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:52.552441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:52.554062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccb511-8f59-42e6-98c6-ab9bf7ffd62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:52.556373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccb511-8f59-42e6-98c6-ab9bf7ffd62b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:52.562203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c9622-662b-46dd-bd83-3afdb6373acc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:52.594699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:52.602087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe71d-e95e-47f9-abc9-20b0dee4cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:52.607970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe71d-e95e-47f9-abc9-20b0dee4cd13 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:52.607970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe71d-e95e-47f9-abc9-20b0dee4cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:52.607970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe71d-e95e-47f9-abc9-20b0dee4cd13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:52.614992 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efe71d-e95e-47f9-abc9-20b0dee4cd13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:52.616970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efe71d-e95e-47f9-abc9-20b0dee4cd13 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-42efe71d-e95e-47f9-abc9-20b0dee4cd13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:13:52.637712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:52.644736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 259/526] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:52.645639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe71d-e95e-47f9-abc9-20b0dee4cd13 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:52.695486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 268/527] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:52.696608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccb511-8f59-42e6-98c6-ab9bf7ffd62b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:52.770611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe71d-e95e-47f9-abc9-20b0dee4cd13 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:52.810906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1a90c-fa52-4d61-8519-0d4db36090ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:52.811619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a90c-fa52-4d61-8519-0d4db36090ce None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:52.811911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a90c-fa52-4d61-8519-0d4db36090ce None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:52.812187 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a90c-fa52-4d61-8519-0d4db36090ce None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:52.812997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1a90c-fa52-4d61-8519-0d4db36090ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:52.813307 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1a90c-fa52-4d61-8519-0d4db36090ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:52.814863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1a90c-fa52-4d61-8519-0d4db36090ce None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:52.845112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 260/528] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:52.845112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1a90c-fa52-4d61-8519-0d4db36090ce None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:52.845506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccb511-8f59-42e6-98c6-ab9bf7ffd62b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:52.866410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:52.881500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:52.887269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ce2fd-d39f-438c-9a47-a437edb37ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:52.888358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ce2fd-d39f-438c-9a47-a437edb37ffb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:52.888792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ce2fd-d39f-438c-9a47-a437edb37ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:52.889216 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ce2fd-d39f-438c-9a47-a437edb37ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:52.900864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ce2fd-d39f-438c-9a47-a437edb37ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:52.902362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ce2fd-d39f-438c-9a47-a437edb37ffb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-0f4ce2fd-d39f-438c-9a47-a437edb37ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:52.924280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:52.925751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:52.926603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:52.926603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:52.926603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:52.926603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:52.926603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 269/529] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:52.926920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ce2fd-d39f-438c-9a47-a437edb37ffb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:52.993832 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1a90c-fa52-4d61-8519-0d4db36090ce None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:53.050753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12d05e-61db-4dfa-8137-2de086425b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:53.051753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d05e-61db-4dfa-8137-2de086425b54 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:53.052076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d05e-61db-4dfa-8137-2de086425b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:53.052355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12d05e-61db-4dfa-8137-2de086425b54 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:53.053729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12d05e-61db-4dfa-8137-2de086425b54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:53.054274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12d05e-61db-4dfa-8137-2de086425b54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:53.056038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12d05e-61db-4dfa-8137-2de086425b54 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:53.062510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ce2fd-d39f-438c-9a47-a437edb37ffb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:53.081559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 261/530] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:53.081559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12d05e-61db-4dfa-8137-2de086425b54 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:53.119668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2d2b5-7df4-4b58-b550-19206970920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:53.120584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d2b5-7df4-4b58-b550-19206970920f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:53.120881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d2b5-7df4-4b58-b550-19206970920f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:53.121212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d2b5-7df4-4b58-b550-19206970920f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:53.134880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2d2b5-7df4-4b58-b550-19206970920f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:53.137429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2d2b5-7df4-4b58-b550-19206970920f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-00d2d2b5-7df4-4b58-b550-19206970920f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:53.157075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:53.158019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:53.158877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:53.158877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:53.158877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:53.158877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:53.163174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 270/531] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:53.164184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2d2b5-7df4-4b58-b550-19206970920f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:53.176306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:53.205366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12d05e-61db-4dfa-8137-2de086425b54 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:53.218020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:53.245362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00598cc-e65c-47ea-8969-34f227432035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:53.245933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00598cc-e65c-47ea-8969-34f227432035 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:53.246215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00598cc-e65c-47ea-8969-34f227432035 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:53.246495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00598cc-e65c-47ea-8969-34f227432035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:53.247330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00598cc-e65c-47ea-8969-34f227432035 None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=5f440bbc0414415186ae83d9fa3842bd) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:53.247741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00598cc-e65c-47ea-8969-34f227432035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:53.249180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00598cc-e65c-47ea-8969-34f227432035 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:53.254966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 262/532] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:53 2022] GET /identity/v3/role_assignments?user.id=5f440bbc0414415186ae83d9fa3842bd&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:53.255611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00598cc-e65c-47ea-8969-34f227432035 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:53.317447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2d2b5-7df4-4b58-b550-19206970920f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:53.371066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040f1cd-b1c5-4750-b046-6af39acccf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:53.371812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040f1cd-b1c5-4750-b046-6af39acccf96 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:53.372096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040f1cd-b1c5-4750-b046-6af39acccf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:53.372373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040f1cd-b1c5-4750-b046-6af39acccf96 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:53.373155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040f1cd-b1c5-4750-b046-6af39acccf96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:53.373462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040f1cd-b1c5-4750-b046-6af39acccf96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:53.374890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040f1cd-b1c5-4750-b046-6af39acccf96 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:53.387801 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 271/533] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:53.392504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00598cc-e65c-47ea-8969-34f227432035 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:53.392684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040f1cd-b1c5-4750-b046-6af39acccf96 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:53.441470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4a100-b37e-4822-9afc-ffa1fd180777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:53.442265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4a100-b37e-4822-9afc-ffa1fd180777 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:53.442693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4a100-b37e-4822-9afc-ffa1fd180777 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:53.442977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4a100-b37e-4822-9afc-ffa1fd180777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:53.443943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4a100-b37e-4822-9afc-ffa1fd180777 None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=3a650b8d49ad480bb1620209a8b7c6e9) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:53.444265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4a100-b37e-4822-9afc-ffa1fd180777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:53.445814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4a100-b37e-4822-9afc-ffa1fd180777 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:53.452802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 263/534] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:53 2022] GET /identity/v3/role_assignments?user.id=3a650b8d49ad480bb1620209a8b7c6e9&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:53.453583 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4a100-b37e-4822-9afc-ffa1fd180777 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:53.458551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:53.530210 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:53.540905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040f1cd-b1c5-4750-b046-6af39acccf96 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:53.586031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4a100-b37e-4822-9afc-ffa1fd180777 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:53.592684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a537674-8c5e-442b-b11d-d168884e1987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:53.594573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a537674-8c5e-442b-b11d-d168884e1987 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:53.595055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a537674-8c5e-442b-b11d-d168884e1987 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:53.595507 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a537674-8c5e-442b-b11d-d168884e1987 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:53.596501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a537674-8c5e-442b-b11d-d168884e1987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:53.596984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a537674-8c5e-442b-b11d-d168884e1987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:53.598574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a537674-8c5e-442b-b11d-d168884e1987 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:53.619735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 272/535] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:53.622058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a537674-8c5e-442b-b11d-d168884e1987 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:53.637248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751938a-f13f-46d2-9ac3-9fd1b06d9ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:53.639301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751938a-f13f-46d2-9ac3-9fd1b06d9ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:53.639828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751938a-f13f-46d2-9ac3-9fd1b06d9ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:53.640880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751938a-f13f-46d2-9ac3-9fd1b06d9ab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:53.651531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751938a-f13f-46d2-9ac3-9fd1b06d9ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:53.654575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751938a-f13f-46d2-9ac3-9fd1b06d9ab8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f751938a-f13f-46d2-9ac3-9fd1b06d9ab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:13:53.676688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:53.677610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:53.678564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:13:53.678564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:13:53.678564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:13:53.678564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:13:53.678564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:13:53.678564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:13:53.678564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:53.678564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:53.681513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 264/536] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:53.688290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751938a-f13f-46d2-9ac3-9fd1b06d9ab8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:53.800361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a537674-8c5e-442b-b11d-d168884e1987 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:53.823974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:53.864304 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1296-9123-4b13-9b90-338b8c052475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:53.865102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1296-9123-4b13-9b90-338b8c052475 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:53.865431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1296-9123-4b13-9b90-338b8c052475 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:53.865708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1296-9123-4b13-9b90-338b8c052475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:53.876492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1296-9123-4b13-9b90-338b8c052475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:53.877959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1296-9123-4b13-9b90-338b8c052475 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-ea8a1296-9123-4b13-9b90-338b8c052475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:13:53.896551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:53.897505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:53.898397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:13:53.898397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:13:53.898397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:13:53.898397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:13:53.898397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:13:53.898397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:13:53.898397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:53.898397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:53.898397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 273/537] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:53.903700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1296-9123-4b13-9b90-338b8c052475 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:53.910548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751938a-f13f-46d2-9ac3-9fd1b06d9ab8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:53.931925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:53.986293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146982a-f542-4547-89e0-491f4025321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:53.986965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146982a-f542-4547-89e0-491f4025321e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:53.987254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146982a-f542-4547-89e0-491f4025321e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:53.987534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146982a-f542-4547-89e0-491f4025321e None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:53.988352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146982a-f542-4547-89e0-491f4025321e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:53.988662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146982a-f542-4547-89e0-491f4025321e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:53.990108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146982a-f542-4547-89e0-491f4025321e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:54.015753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 265/538] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:54.021910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146982a-f542-4547-89e0-491f4025321e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:54.097632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1296-9123-4b13-9b90-338b8c052475 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:54.141724 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88858d-e900-4f95-84c0-68ba0a94352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:54.142541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88858d-e900-4f95-84c0-68ba0a94352b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:54.142874 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88858d-e900-4f95-84c0-68ba0a94352b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:54.143184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88858d-e900-4f95-84c0-68ba0a94352b None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:54.144199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88858d-e900-4f95-84c0-68ba0a94352b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:54.144561 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88858d-e900-4f95-84c0-68ba0a94352b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:54.144874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146982a-f542-4547-89e0-491f4025321e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:54.146428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88858d-e900-4f95-84c0-68ba0a94352b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:54.170595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 274/539] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:54.174024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d1ca-9777-408e-99a8-18d5515b9a92 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:54.174024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d1ca-9777-408e-99a8-18d5515b9a92 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:54.174024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93d1ca-9777-408e-99a8-18d5515b9a92 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:54.174464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 275/540] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:54.180595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:54.181274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d1ca-9777-408e-99a8-18d5515b9a92 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:54.193017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad7892-9a6f-4216-a967-e8fef6441f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:54.193677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7892-9a6f-4216-a967-e8fef6441f73 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:54.193953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7892-9a6f-4216-a967-e8fef6441f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:54.194237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad7892-9a6f-4216-a967-e8fef6441f73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:54.195081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad7892-9a6f-4216-a967-e8fef6441f73 None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=ed487d7f2dde42268c57a5330b6c5b23) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:54.195393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad7892-9a6f-4216-a967-e8fef6441f73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:54.196905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad7892-9a6f-4216-a967-e8fef6441f73 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:54.207730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 266/541] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:54 2022] GET /identity/v3/role_assignments?user.id=ed487d7f2dde42268c57a5330b6c5b23&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:13:54.209810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b108d3-78c9-4c96-9c33-5b745291faa8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:54.210390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b108d3-78c9-4c96-9c33-5b745291faa8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:54.211002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b108d3-78c9-4c96-9c33-5b745291faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:54.258076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-95b108d3-78c9-4c96-9c33-5b745291faa8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:54.260034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-95b108d3-78c9-4c96-9c33-5b745291faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:54.364047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:54.410779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 267/542] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:54.417099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93d1ca-9777-408e-99a8-18d5515b9a92 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:54.463467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b108d3-78c9-4c96-9c33-5b745291faa8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:54.465881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc4a33-9eeb-4af2-82ca-678113c6cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:54.468295 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc4a33-9eeb-4af2-82ca-678113c6cf06 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:54.468683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc4a33-9eeb-4af2-82ca-678113c6cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:54.469060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc4a33-9eeb-4af2-82ca-678113c6cf06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:54.470006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc4a33-9eeb-4af2-82ca-678113c6cf06 None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=8571493023904002bd334e74441d134d) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:54.470423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc4a33-9eeb-4af2-82ca-678113c6cf06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:54.472070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc4a33-9eeb-4af2-82ca-678113c6cf06 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:54.483674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 276/543] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:54 2022] GET /identity/v3/role_assignments?user.id=8571493023904002bd334e74441d134d&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:54.584372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b108d3-78c9-4c96-9c33-5b745291faa8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:54.621030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:54.652209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3827d83-3b72-494e-b768-345c24d80f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:54.653063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827d83-3b72-494e-b768-345c24d80f04 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:54.653351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827d83-3b72-494e-b768-345c24d80f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:54.653633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827d83-3b72-494e-b768-345c24d80f04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:54.670856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3827d83-3b72-494e-b768-345c24d80f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a3827d83-3b72-494e-b768-345c24d80f04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:54.679091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:54.680116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:54.680918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:54.683470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 268/544] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:54.690001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc4a33-9eeb-4af2-82ca-678113c6cf06 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:54.833514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc4a33-9eeb-4af2-82ca-678113c6cf06 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:54.879351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c266bf-3e1e-4e01-adce-2e01966d1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:54.879968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c266bf-3e1e-4e01-adce-2e01966d1f55 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:54.880252 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c266bf-3e1e-4e01-adce-2e01966d1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:54.880530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c266bf-3e1e-4e01-adce-2e01966d1f55 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:54.881286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c266bf-3e1e-4e01-adce-2e01966d1f55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:54.881592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c266bf-3e1e-4e01-adce-2e01966d1f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:54.882973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c266bf-3e1e-4e01-adce-2e01966d1f55 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:54.896158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 277/545] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:13:54 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:54.901607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3827d83-3b72-494e-b768-345c24d80f04 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:55.043670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3827d83-3b72-494e-b768-345c24d80f04 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:55.093985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0444-a67f-440f-804d-4272f104dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:55.095142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0444-a67f-440f-804d-4272f104dc60 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:55.095648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0444-a67f-440f-804d-4272f104dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:55.096135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0444-a67f-440f-804d-4272f104dc60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:55.119355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0444-a67f-440f-804d-4272f104dc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:55.121170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a0444-a67f-440f-804d-4272f104dc60 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5e6a0444-a67f-440f-804d-4272f104dc60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:55.144103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:55.145030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:55.145890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:55.145890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:55.145890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:55.145890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:55.147979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 269/546] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:55.155940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c266bf-3e1e-4e01-adce-2e01966d1f55 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:55.162235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:55.313890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c266bf-3e1e-4e01-adce-2e01966d1f55 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:55.355188 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec233f-5089-4753-85ed-b37ce7621b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:55.355908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec233f-5089-4753-85ed-b37ce7621b27 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:55.356195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec233f-5089-4753-85ed-b37ce7621b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:55.356474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec233f-5089-4753-85ed-b37ce7621b27 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:55.357518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec233f-5089-4753-85ed-b37ce7621b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:55.357830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec233f-5089-4753-85ed-b37ce7621b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:55.359233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec233f-5089-4753-85ed-b37ce7621b27 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:55.382121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 278/547] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:55.387726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0444-a67f-440f-804d-4272f104dc60 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:55.443687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:55.547621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0444-a67f-440f-804d-4272f104dc60 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:55.598093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348e5b9-6cd1-4b97-93af-b79809dfa510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:55.598892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348e5b9-6cd1-4b97-93af-b79809dfa510 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:55.599172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348e5b9-6cd1-4b97-93af-b79809dfa510 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:55.599443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348e5b9-6cd1-4b97-93af-b79809dfa510 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:55.608732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348e5b9-6cd1-4b97-93af-b79809dfa510 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:55.610228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348e5b9-6cd1-4b97-93af-b79809dfa510 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a348e5b9-6cd1-4b97-93af-b79809dfa510 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:13:55.628638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:55.630126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:55.631216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 270/548] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:13:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:55.637602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec233f-5089-4753-85ed-b37ce7621b27 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:55.740321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:55.794143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec233f-5089-4753-85ed-b37ce7621b27 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:55.828736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c39866-05e4-4f38-bb1d-5266152c8474 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:55.829043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c39866-05e4-4f38-bb1d-5266152c8474 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:55.829290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c39866-05e4-4f38-bb1d-5266152c8474 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:55.830928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 271/549] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:55.835874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd71cb6-bf63-4e5a-809d-b568c1bfaf3b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:55.836161 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd71cb6-bf63-4e5a-809d-b568c1bfaf3b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:55.836439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd71cb6-bf63-4e5a-809d-b568c1bfaf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:55.838687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23565c-ffc6-4907-bb68-ded1b7dca056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:55.839362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23565c-ffc6-4907-bb68-ded1b7dca056 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:55.839696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23565c-ffc6-4907-bb68-ded1b7dca056 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:55.840004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23565c-ffc6-4907-bb68-ded1b7dca056 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:55.840825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23565c-ffc6-4907-bb68-ded1b7dca056 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:55.841134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23565c-ffc6-4907-bb68-ded1b7dca056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:55.843114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23565c-ffc6-4907-bb68-ded1b7dca056 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:55.870639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ccd71cb6-bf63-4e5a-809d-b568c1bfaf3b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:55.871904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ccd71cb6-bf63-4e5a-809d-b568c1bfaf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:55.878493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 279/550] 10.222.0.112 () {56 vars in 1140 bytes} [Fri Jun 3 16:13:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:55.889289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23565c-ffc6-4907-bb68-ded1b7dca056 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:56.026511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 272/551] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:56.048456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23565c-ffc6-4907-bb68-ded1b7dca056 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:56.059257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd71cb6-bf63-4e5a-809d-b568c1bfaf3b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:56.090140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:56.095074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:56.125338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4d85d-e815-4321-82c2-b5ef677a32e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:56.125997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4d85d-e815-4321-82c2-b5ef677a32e0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:56.126281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4d85d-e815-4321-82c2-b5ef677a32e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:56.126552 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4d85d-e815-4321-82c2-b5ef677a32e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:56.240427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd71cb6-bf63-4e5a-809d-b568c1bfaf3b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:56.257881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4d85d-e815-4321-82c2-b5ef677a32e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:56.259642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4d85d-e815-4321-82c2-b5ef677a32e0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:56.278517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ca795-11b9-43e5-a873-77baa3be9a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:56.279263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca795-11b9-43e5-a873-77baa3be9a25 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:56.279543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca795-11b9-43e5-a873-77baa3be9a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:56.279844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca795-11b9-43e5-a873-77baa3be9a25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:56.290619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ca795-11b9-43e5-a873-77baa3be9a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8c4ca795-11b9-43e5-a873-77baa3be9a25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:56.298376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:56.299388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:56.300241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 273/552] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:56.301403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006375-86cc-41e8-9520-42d96d6e4c15 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:56.301562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006375-86cc-41e8-9520-42d96d6e4c15 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:56.306193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3006375-86cc-41e8-9520-42d96d6e4c15 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:56.306193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 274/553] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:56.309746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3006375-86cc-41e8-9520-42d96d6e4c15 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:56.382135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 280/554] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:13:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:56.382135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4230f-0cfe-4a6b-8ef7-9a7b682727fd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:56.382135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4230f-0cfe-4a6b-8ef7-9a7b682727fd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:56.382135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4230f-0cfe-4a6b-8ef7-9a7b682727fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:56.398060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-18f4230f-0cfe-4a6b-8ef7-9a7b682727fd None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:56.399116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-18f4230f-0cfe-4a6b-8ef7-9a7b682727fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:56.415073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:56.431117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:56.456734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3006375-86cc-41e8-9520-42d96d6e4c15 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:56.499578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 281/555] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:56.499578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4230f-0cfe-4a6b-8ef7-9a7b682727fd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:56.517884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031e21-5bb3-47ee-93b3-1326f986c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:56.518706 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031e21-5bb3-47ee-93b3-1326f986c32e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:56.519327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031e21-5bb3-47ee-93b3-1326f986c32e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:56.519901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031e21-5bb3-47ee-93b3-1326f986c32e None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:56.520999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11031e21-5bb3-47ee-93b3-1326f986c32e None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:56.521523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11031e21-5bb3-47ee-93b3-1326f986c32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:56.523148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11031e21-5bb3-47ee-93b3-1326f986c32e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:56.533399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 275/556] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:13:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:56.539043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031e21-5bb3-47ee-93b3-1326f986c32e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:56.627977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4230f-0cfe-4a6b-8ef7-9a7b682727fd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:56.649385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031e21-5bb3-47ee-93b3-1326f986c32e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:56.668163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924797b9-d576-4969-827b-8f45ac552ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:56.669114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924797b9-d576-4969-827b-8f45ac552ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:56.669437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924797b9-d576-4969-827b-8f45ac552ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:56.669722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924797b9-d576-4969-827b-8f45ac552ec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:56.681966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924797b9-d576-4969-827b-8f45ac552ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:56.683545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924797b9-d576-4969-827b-8f45ac552ec6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:56.687865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583eed-db72-4091-bf3a-10597b88fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:56.688950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583eed-db72-4091-bf3a-10597b88fc2d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:56.689494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583eed-db72-4091-bf3a-10597b88fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:56.689984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583eed-db72-4091-bf3a-10597b88fc2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:56.702392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583eed-db72-4091-bf3a-10597b88fc2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-924797b9-d576-4969-827b-8f45ac552ec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:56.704627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:56.705546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:56.706602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:56.706602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:56.706602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:56.706602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:56.711932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 282/557] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:56.712898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924797b9-d576-4969-827b-8f45ac552ec6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-aa583eed-db72-4091-bf3a-10597b88fc2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:56.714112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:56.715591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:56.717090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:56.717775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:56.719619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 276/558] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:56.720681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583eed-db72-4091-bf3a-10597b88fc2d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:56.729246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:56.858867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924797b9-d576-4969-827b-8f45ac552ec6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:56.875465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583eed-db72-4091-bf3a-10597b88fc2d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:56.905673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aa2b3-4007-4090-9627-1113d6d87c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:56.906610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aa2b3-4007-4090-9627-1113d6d87c33 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:56.906904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aa2b3-4007-4090-9627-1113d6d87c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:56.907186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aa2b3-4007-4090-9627-1113d6d87c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:56.916685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cceb4-4607-4f26-b6f5-76878328ce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:56.917742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cceb4-4607-4f26-b6f5-76878328ce6e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:56.918228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cceb4-4607-4f26-b6f5-76878328ce6e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:56.918707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cceb4-4607-4f26-b6f5-76878328ce6e None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:56.919793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cceb4-4607-4f26-b6f5-76878328ce6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:56.920354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cceb4-4607-4f26-b6f5-76878328ce6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:56.920578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aa2b3-4007-4090-9627-1113d6d87c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:56.922097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aa2b3-4007-4090-9627-1113d6d87c33 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:56.922430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cceb4-4607-4f26-b6f5-76878328ce6e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:56.936044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 277/559] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:56.937248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cceb4-4607-4f26-b6f5-76878328ce6e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-937aa2b3-4007-4090-9627-1113d6d87c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:56.946752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:56.947800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:56.948739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:56.948739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:56.948739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:56.948739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:56.953104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 283/560] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:56.953963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aa2b3-4007-4090-9627-1113d6d87c33 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:57.008675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:57.020265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:57.055755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cceb4-4607-4f26-b6f5-76878328ce6e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:57.073947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aa2b3-4007-4090-9627-1113d6d87c33 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:57.095810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e433a4-5962-4b6f-b542-6542a8faafe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:57.096712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e433a4-5962-4b6f-b542-6542a8faafe2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.097112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e433a4-5962-4b6f-b542-6542a8faafe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.097490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e433a4-5962-4b6f-b542-6542a8faafe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.098647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e433a4-5962-4b6f-b542-6542a8faafe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:57.098647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e433a4-5962-4b6f-b542-6542a8faafe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:57.100315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e433a4-5962-4b6f-b542-6542a8faafe2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:57.115430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 278/561] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:13:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:57.117120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e433a4-5962-4b6f-b542-6542a8faafe2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:57.121107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4cdc8-9cac-4689-ada8-accf1df18443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:57.121816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4cdc8-9cac-4689-ada8-accf1df18443 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.122155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4cdc8-9cac-4689-ada8-accf1df18443 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.122479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4cdc8-9cac-4689-ada8-accf1df18443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.136447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4cdc8-9cac-4689-ada8-accf1df18443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:57.139188 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4cdc8-9cac-4689-ada8-accf1df18443 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-55c4cdc8-9cac-4689-ada8-accf1df18443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:13:57.165289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:57.166367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:57.167264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:13:57.167264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:13:57.167264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:13:57.167264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:13:57.167264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:13:57.167264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:13:57.167264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:57.167264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:57.173211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 284/562] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:57.173211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4cdc8-9cac-4689-ada8-accf1df18443 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:57.264572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e433a4-5962-4b6f-b542-6542a8faafe2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:57.302112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:57.315805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4cdc8-9cac-4689-ada8-accf1df18443 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:57.317568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2fce0-a481-400d-bc8d-ea1c7fad778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:57.318239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2fce0-a481-400d-bc8d-ea1c7fad778a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.318524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2fce0-a481-400d-bc8d-ea1c7fad778a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.318801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2fce0-a481-400d-bc8d-ea1c7fad778a None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.319532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2fce0-a481-400d-bc8d-ea1c7fad778a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:57.319873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2fce0-a481-400d-bc8d-ea1c7fad778a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:57.321290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2fce0-a481-400d-bc8d-ea1c7fad778a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:57.331038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:57.334304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 279/563] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:57.335049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2fce0-a481-400d-bc8d-ea1c7fad778a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:57.356428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cabb4-0851-4a42-a868-81ba720fb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:57.358041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cabb4-0851-4a42-a868-81ba720fb67a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.358323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cabb4-0851-4a42-a868-81ba720fb67a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.358723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cabb4-0851-4a42-a868-81ba720fb67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.369641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cabb4-0851-4a42-a868-81ba720fb67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:57.371032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cabb4-0851-4a42-a868-81ba720fb67a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-fe2cabb4-0851-4a42-a868-81ba720fb67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:57.389221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:57.390193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:57.391100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:57.391100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:57.391100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:57.391100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:57.391100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 285/564] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:57.391690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987c24e-db75-4438-af64-e87ef246e0b5 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.391992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987c24e-db75-4438-af64-e87ef246e0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.392258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987c24e-db75-4438-af64-e87ef246e0b5 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.393795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 286/565] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:57.394964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c94f7-eb45-4052-baf6-39453be2e79f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.395492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c94f7-eb45-4052-baf6-39453be2e79f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.395909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c94f7-eb45-4052-baf6-39453be2e79f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.397288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 287/566] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:13:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:13:57.397917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c94f7-eb45-4052-baf6-39453be2e79f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:57.447075 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2fce0-a481-400d-bc8d-ea1c7fad778a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:57.483311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218a1cf-9155-4cfd-ab6d-986c6014b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:57.484007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218a1cf-9155-4cfd-ab6d-986c6014b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.484290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218a1cf-9155-4cfd-ab6d-986c6014b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.484570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218a1cf-9155-4cfd-ab6d-986c6014b4e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.485650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218a1cf-9155-4cfd-ab6d-986c6014b4e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:57.485650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218a1cf-9155-4cfd-ab6d-986c6014b4e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:57.487129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218a1cf-9155-4cfd-ab6d-986c6014b4e2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:57.499576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 280/567] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:57.500442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218a1cf-9155-4cfd-ab6d-986c6014b4e2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:57.509474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c94f7-eb45-4052-baf6-39453be2e79f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:57.547303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a48b88-d8d8-44a3-9fb3-a6f0f5d0bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:57.548229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a48b88-d8d8-44a3-9fb3-a6f0f5d0bb41 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.548511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a48b88-d8d8-44a3-9fb3-a6f0f5d0bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.548787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a48b88-d8d8-44a3-9fb3-a6f0f5d0bb41 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.557651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:57.561582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a48b88-d8d8-44a3-9fb3-a6f0f5d0bb41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:57.563972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a48b88-d8d8-44a3-9fb3-a6f0f5d0bb41 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-a7a48b88-d8d8-44a3-9fb3-a6f0f5d0bb41 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:13:57.579907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:57.582190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 288/568] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631beb8e-a9ea-4e3a-81d0-a2cbf25ead68 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.584777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631beb8e-a9ea-4e3a-81d0-a2cbf25ead68 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.586192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631beb8e-a9ea-4e3a-81d0-a2cbf25ead68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.604220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-631beb8e-a9ea-4e3a-81d0-a2cbf25ead68 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:57.605545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-631beb8e-a9ea-4e3a-81d0-a2cbf25ead68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:57.628250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:57.631561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218a1cf-9155-4cfd-ab6d-986c6014b4e2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:57.677893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6116-c8c5-4333-b0cc-b398bbf28e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:57.678617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6116-c8c5-4333-b0cc-b398bbf28e11 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.679257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6116-c8c5-4333-b0cc-b398bbf28e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.679257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6116-c8c5-4333-b0cc-b398bbf28e11 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.680029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6116-c8c5-4333-b0cc-b398bbf28e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:57.680338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6116-c8c5-4333-b0cc-b398bbf28e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:57.681773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6116-c8c5-4333-b0cc-b398bbf28e11 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:57.701111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 289/569] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:57.701111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787932b4-416d-4e6b-85e6-77288a15907c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.701420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 281/570] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:57.701510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787932b4-416d-4e6b-85e6-77288a15907c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.701510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787932b4-416d-4e6b-85e6-77288a15907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.701639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6116-c8c5-4333-b0cc-b398bbf28e11 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:57.718649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-787932b4-416d-4e6b-85e6-77288a15907c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:13:57.720506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-787932b4-416d-4e6b-85e6-77288a15907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:13:57.806232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6116-c8c5-4333-b0cc-b398bbf28e11 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:57.808659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:57.812811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 290/571] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:13:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:13:57.813620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787932b4-416d-4e6b-85e6-77288a15907c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:57.851507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029e241-7f89-4fd2-8344-52ff7af2273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:57.852430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e241-7f89-4fd2-8344-52ff7af2273b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:57.852714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e241-7f89-4fd2-8344-52ff7af2273b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:57.852988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e241-7f89-4fd2-8344-52ff7af2273b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:57.854099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e241-7f89-4fd2-8344-52ff7af2273b None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=f8e7179f5fe945f4be1ca16263042b3f) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:57.854410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e241-7f89-4fd2-8344-52ff7af2273b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:57.855895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e241-7f89-4fd2-8344-52ff7af2273b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:57.861990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 282/572] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:13:57 2022] GET /identity/v3/role_assignments?user.id=f8e7179f5fe945f4be1ca16263042b3f&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:57.862833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029e241-7f89-4fd2-8344-52ff7af2273b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:57.930211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:57.954502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787932b4-416d-4e6b-85e6-77288a15907c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:57.993984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029e241-7f89-4fd2-8344-52ff7af2273b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:58.011896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2596c72-3440-4b18-9ff6-ad8d74dd4f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.012614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2596c72-3440-4b18-9ff6-ad8d74dd4f79 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.012902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2596c72-3440-4b18-9ff6-ad8d74dd4f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.013866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2596c72-3440-4b18-9ff6-ad8d74dd4f79 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.014767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2596c72-3440-4b18-9ff6-ad8d74dd4f79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:58.015082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2596c72-3440-4b18-9ff6-ad8d74dd4f79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:58.016651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2596c72-3440-4b18-9ff6-ad8d74dd4f79 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:58.037511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 291/573] 10.222.0.112 () {56 vars in 1142 bytes} [Fri Jun 3 16:13:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:58.038611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ba42d-f4b2-442a-9699-a4267d3c6ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.039698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ba42d-f4b2-442a-9699-a4267d3c6ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.040296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ba42d-f4b2-442a-9699-a4267d3c6ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.040768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ba42d-f4b2-442a-9699-a4267d3c6ad6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.043012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2596c72-3440-4b18-9ff6-ad8d74dd4f79 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:58.051116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ba42d-f4b2-442a-9699-a4267d3c6ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:58.053213 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ba42d-f4b2-442a-9699-a4267d3c6ad6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-706ba42d-f4b2-442a-9699-a4267d3c6ad6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:13:58.070348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:58.071951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:13:58.072966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:58.074999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 283/574] 10.222.0.112 () {56 vars in 1098 bytes} [Fri Jun 3 16:13:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:58.076684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ba42d-f4b2-442a-9699-a4267d3c6ad6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:58.115014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:58.201901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2596c72-3440-4b18-9ff6-ad8d74dd4f79 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:58.219290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ba42d-f4b2-442a-9699-a4267d3c6ad6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:58.251775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b02faf-6881-4931-9120-d1c8951c38f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.252574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b02faf-6881-4931-9120-d1c8951c38f4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.252857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b02faf-6881-4931-9120-d1c8951c38f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.253138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b02faf-6881-4931-9120-d1c8951c38f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.259620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9ef10-34ce-4eb9-92ac-c0abbd27cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.260428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9ef10-34ce-4eb9-92ac-c0abbd27cb99 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.260719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9ef10-34ce-4eb9-92ac-c0abbd27cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.260992 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9ef10-34ce-4eb9-92ac-c0abbd27cb99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.265102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b02faf-6881-4931-9120-d1c8951c38f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:58.272334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9ef10-34ce-4eb9-92ac-c0abbd27cb99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-e4b02faf-6881-4931-9120-d1c8951c38f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:58.273854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:58.274963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:58.276051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5dd9ef10-34ce-4eb9-92ac-c0abbd27cb99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:13:58.283024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:58.284109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 284/575] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:58.284995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9ef10-34ce-4eb9-92ac-c0abbd27cb99 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:58.286343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 292/576] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:58.287473 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b02faf-6881-4931-9120-d1c8951c38f4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:58.291923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:58.383585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:58.397308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9ef10-34ce-4eb9-92ac-c0abbd27cb99 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:58.412121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b02faf-6881-4931-9120-d1c8951c38f4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:58.438139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3e0c-52a9-41c3-aebb-deb03e1ec1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.438949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3e0c-52a9-41c3-aebb-deb03e1ec1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.439247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3e0c-52a9-41c3-aebb-deb03e1ec1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.439507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3e0c-52a9-41c3-aebb-deb03e1ec1b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.451408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3e0c-52a9-41c3-aebb-deb03e1ec1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:58.451664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407857-5bfb-4dd0-b680-8f55d10c7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.452373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407857-5bfb-4dd0-b680-8f55d10c7046 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.452630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407857-5bfb-4dd0-b680-8f55d10c7046 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.452849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407857-5bfb-4dd0-b680-8f55d10c7046 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.452961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3e0c-52a9-41c3-aebb-deb03e1ec1b2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:58.453695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407857-5bfb-4dd0-b680-8f55d10c7046 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:58.454003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407857-5bfb-4dd0-b680-8f55d10c7046 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:58.455449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407857-5bfb-4dd0-b680-8f55d10c7046 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e3ba3e0c-52a9-41c3-aebb-deb03e1ec1b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:58.472550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:58.473654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:58.478866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:58.478866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:58.478866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:58.478866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:58.478866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 285/577] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:58.478866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3e0c-52a9-41c3-aebb-deb03e1ec1b2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:58.485802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 293/578] 10.222.0.112 () {56 vars in 1138 bytes} [Fri Jun 3 16:13:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:58.486541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407857-5bfb-4dd0-b680-8f55d10c7046 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:58.563615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:58.605102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3e0c-52a9-41c3-aebb-deb03e1ec1b2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:58.612939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407857-5bfb-4dd0-b680-8f55d10c7046 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:58.655536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77eab66-27da-4cea-bd51-c176b1c21571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.656306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77eab66-27da-4cea-bd51-c176b1c21571 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.656585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77eab66-27da-4cea-bd51-c176b1c21571 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.656927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77eab66-27da-4cea-bd51-c176b1c21571 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.657753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77eab66-27da-4cea-bd51-c176b1c21571 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:58.658118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77eab66-27da-4cea-bd51-c176b1c21571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:58.659616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77eab66-27da-4cea-bd51-c176b1c21571 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:58.668900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 286/579] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:13:58 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:58.670362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77eab66-27da-4cea-bd51-c176b1c21571 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:58.675651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bde4b-e19d-48cb-af62-8739a51fad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.677213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bde4b-e19d-48cb-af62-8739a51fad89 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.677352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:58.678462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bde4b-e19d-48cb-af62-8739a51fad89 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.679604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bde4b-e19d-48cb-af62-8739a51fad89 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.680440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bde4b-e19d-48cb-af62-8739a51fad89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:58.680843 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bde4b-e19d-48cb-af62-8739a51fad89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:58.683170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881bde4b-e19d-48cb-af62-8739a51fad89 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:58.703458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 294/580] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:13:58 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:58.703458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bde4b-e19d-48cb-af62-8739a51fad89 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:58.819946 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77eab66-27da-4cea-bd51-c176b1c21571 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:58.871511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cae19-fbfc-4069-aca7-f41374bd9cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.872218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cae19-fbfc-4069-aca7-f41374bd9cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.872541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cae19-fbfc-4069-aca7-f41374bd9cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.872824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cae19-fbfc-4069-aca7-f41374bd9cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.873579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cae19-fbfc-4069-aca7-f41374bd9cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:58.873888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cae19-fbfc-4069-aca7-f41374bd9cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:58.875314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cae19-fbfc-4069-aca7-f41374bd9cc4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:58.887569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881bde4b-e19d-48cb-af62-8739a51fad89 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:58.898164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 287/581] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:58.899662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cae19-fbfc-4069-aca7-f41374bd9cc4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:58.928551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:58.949476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37607929-3b64-4d9b-ae92-c1d0f030a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:58.951403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37607929-3b64-4d9b-ae92-c1d0f030a466 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:58.951946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37607929-3b64-4d9b-ae92-c1d0f030a466 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:58.952556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37607929-3b64-4d9b-ae92-c1d0f030a466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:58.974559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37607929-3b64-4d9b-ae92-c1d0f030a466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:58.976872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37607929-3b64-4d9b-ae92-c1d0f030a466 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-37607929-3b64-4d9b-ae92-c1d0f030a466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:59.006547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:59.007690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:59.008624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:59.008624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:59.008624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:59.008624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:59.008624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 295/582] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:59.010134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37607929-3b64-4d9b-ae92-c1d0f030a466 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.021250 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:59.089585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cae19-fbfc-4069-aca7-f41374bd9cc4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.127883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fc866-e507-430a-9af0-333f45f1ef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.128438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fc866-e507-430a-9af0-333f45f1ef74 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.128720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fc866-e507-430a-9af0-333f45f1ef74 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.128999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fc866-e507-430a-9af0-333f45f1ef74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.140255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fc866-e507-430a-9af0-333f45f1ef74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.140819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37607929-3b64-4d9b-ae92-c1d0f030a466 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.141777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fc866-e507-430a-9af0-333f45f1ef74 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f99fc866-e507-430a-9af0-333f45f1ef74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:59.161360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:59.162352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:59.163268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:59.163268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:59.163268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:59.163268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:59.163268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 288/583] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:59.164022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fc866-e507-430a-9af0-333f45f1ef74 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.187595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25bc65-83a4-4c62-943d-8612949bf035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.188375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25bc65-83a4-4c62-943d-8612949bf035 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.188661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25bc65-83a4-4c62-943d-8612949bf035 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.188946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25bc65-83a4-4c62-943d-8612949bf035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.202297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25bc65-83a4-4c62-943d-8612949bf035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.203827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25bc65-83a4-4c62-943d-8612949bf035 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-ef25bc65-83a4-4c62-943d-8612949bf035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:13:59.224369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:59.225882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:59.226827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:13:59.226827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:13:59.226827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:13:59.226827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:59.226827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 296/584] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:59.226827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25bc65-83a4-4c62-943d-8612949bf035 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.263051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:59.299625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fc866-e507-430a-9af0-333f45f1ef74 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.318802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:59.346844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25bc65-83a4-4c62-943d-8612949bf035 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.348120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c1a7b-435b-424b-a51f-0aba83b0017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.350412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c1a7b-435b-424b-a51f-0aba83b0017c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.351002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c1a7b-435b-424b-a51f-0aba83b0017c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.351496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c1a7b-435b-424b-a51f-0aba83b0017c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.362359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c1a7b-435b-424b-a51f-0aba83b0017c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.364508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c1a7b-435b-424b-a51f-0aba83b0017c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e68c1a7b-435b-424b-a51f-0aba83b0017c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:13:59.381741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:59.382776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:59.383810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:13:59.383810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:13:59.383810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:13:59.383810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:13:59.383810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:13:59.383810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:13:59.383810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:59.383810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:59.383810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 289/585] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:59.384354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c1a7b-435b-424b-a51f-0aba83b0017c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.393417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0511f-4abd-43a6-b653-96fff979ba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.394263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0511f-4abd-43a6-b653-96fff979ba18 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.394653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0511f-4abd-43a6-b653-96fff979ba18 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.395610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0511f-4abd-43a6-b653-96fff979ba18 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.396469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0511f-4abd-43a6-b653-96fff979ba18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:59.396910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0511f-4abd-43a6-b653-96fff979ba18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.399144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0511f-4abd-43a6-b653-96fff979ba18 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.413522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 297/586] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:59.414696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0511f-4abd-43a6-b653-96fff979ba18 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.512587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c1a7b-435b-424b-a51f-0aba83b0017c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.516460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:59.530496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0511f-4abd-43a6-b653-96fff979ba18 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.554547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4b0b-b0da-45c2-8275-ee3df9022d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.555322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4b0b-b0da-45c2-8275-ee3df9022d03 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.555719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4b0b-b0da-45c2-8275-ee3df9022d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.556029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4b0b-b0da-45c2-8275-ee3df9022d03 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.556771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d4b0b-b0da-45c2-8275-ee3df9022d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:59.557102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d4b0b-b0da-45c2-8275-ee3df9022d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.558514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d4b0b-b0da-45c2-8275-ee3df9022d03 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.569724 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513e3d0-7824-47ed-b352-e84957e4149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.570390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513e3d0-7824-47ed-b352-e84957e4149a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.570672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513e3d0-7824-47ed-b352-e84957e4149a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.570951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513e3d0-7824-47ed-b352-e84957e4149a None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.571728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513e3d0-7824-47ed-b352-e84957e4149a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:59.572035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513e3d0-7824-47ed-b352-e84957e4149a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.573425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513e3d0-7824-47ed-b352-e84957e4149a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.577697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 290/587] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:59.578639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4b0b-b0da-45c2-8275-ee3df9022d03 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.590984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 298/588] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:59.590984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513e3d0-7824-47ed-b352-e84957e4149a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.622087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:59.696440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4b0b-b0da-45c2-8275-ee3df9022d03 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.710100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513e3d0-7824-47ed-b352-e84957e4149a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.733717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d87830-39a0-419c-88de-4ea854a68707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.734775 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d87830-39a0-419c-88de-4ea854a68707 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.735156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d87830-39a0-419c-88de-4ea854a68707 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.735685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d87830-39a0-419c-88de-4ea854a68707 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.736903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d87830-39a0-419c-88de-4ea854a68707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:13:59.737474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d87830-39a0-419c-88de-4ea854a68707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.739403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d87830-39a0-419c-88de-4ea854a68707 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.746903 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c7546-8e6f-4385-814a-d12adbfa3826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.748452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7546-8e6f-4385-814a-d12adbfa3826 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.748833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7546-8e6f-4385-814a-d12adbfa3826 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.749211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c7546-8e6f-4385-814a-d12adbfa3826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.758934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 291/589] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:13:59.758934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d87830-39a0-419c-88de-4ea854a68707 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.759197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c7546-8e6f-4385-814a-d12adbfa3826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.759197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c7546-8e6f-4385-814a-d12adbfa3826 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-415c7546-8e6f-4385-814a-d12adbfa3826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:13:59.775503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:59.776717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 299/590] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:59.777826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c7546-8e6f-4385-814a-d12adbfa3826 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.790087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:59.863914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:59.873635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d87830-39a0-419c-88de-4ea854a68707 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.892777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c7546-8e6f-4385-814a-d12adbfa3826 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:13:59.910683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb0608-2471-4120-b0fa-04abca12d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.911508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb0608-2471-4120-b0fa-04abca12d365 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.911825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb0608-2471-4120-b0fa-04abca12d365 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.912101 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb0608-2471-4120-b0fa-04abca12d365 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.920421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb0608-2471-4120-b0fa-04abca12d365 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.921864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb0608-2471-4120-b0fa-04abca12d365 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.930509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d3df8-0479-4f68-b195-71ed66e72e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:13:59.931359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d3df8-0479-4f68-b195-71ed66e72e11 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:13:59.931735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d3df8-0479-4f68-b195-71ed66e72e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:13:59.932073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d3df8-0479-4f68-b195-71ed66e72e11 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-40fb0608-2471-4120-b0fa-04abca12d365 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:13:59.936719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:59.937912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 292/591] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:59.943781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb0608-2471-4120-b0fa-04abca12d365 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:13:59.946484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d3df8-0479-4f68-b195-71ed66e72e11 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:13:59.947541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d3df8-0479-4f68-b195-71ed66e72e11 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-8e4d3df8-0479-4f68-b195-71ed66e72e11 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:13:59.962545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:13:59.964377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 16:13:59.965578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:13:59.969158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 300/592] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:13:59.969964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d3df8-0479-4f68-b195-71ed66e72e11 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:00.051132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:00.081605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb0608-2471-4120-b0fa-04abca12d365 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:00.098987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d3df8-0479-4f68-b195-71ed66e72e11 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:00.122554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa034e0-7508-459b-ab3b-975171673a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:00.123456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa034e0-7508-459b-ab3b-975171673a34 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.123776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa034e0-7508-459b-ab3b-975171673a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.124062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa034e0-7508-459b-ab3b-975171673a34 None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/5f440bbc0414415186ae83d9fa3842bd/roles/32d5f0d8a0564b0286e98637266edf11` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.138688 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90a42d-9f1e-4be5-8583-1637f3a8ab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:00.139892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90a42d-9f1e-4be5-8583-1637f3a8ab67 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.140357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90a42d-9f1e-4be5-8583-1637f3a8ab67 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.140865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90a42d-9f1e-4be5-8583-1637f3a8ab67 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.141157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa034e0-7508-459b-ab3b-975171673a34 None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=5f440bbc0414415186ae83d9fa3842bd, role_id=32d5f0d8a0564b0286e98637266edf11)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:00.142371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90a42d-9f1e-4be5-8583-1637f3a8ab67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:00.142696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa034e0-7508-459b-ab3b-975171673a34 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:00.143079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90a42d-9f1e-4be5-8583-1637f3a8ab67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:00.145737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90a42d-9f1e-4be5-8583-1637f3a8ab67 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:00.160767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 293/593] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:13:59 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/5f440bbc0414415186ae83d9fa3842bd/roles/32d5f0d8a0564b0286e98637266edf11 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:14:00.161615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa034e0-7508-459b-ab3b-975171673a34 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:00.166863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:00.187707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 301/594] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:00.187707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90a42d-9f1e-4be5-8583-1637f3a8ab67 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:00.290758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa034e0-7508-459b-ab3b-975171673a34 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:00.329280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90a42d-9f1e-4be5-8583-1637f3a8ab67 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:00.330919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add9e68-9c2c-4521-bfd2-edad525d24ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:00.331640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add9e68-9c2c-4521-bfd2-edad525d24ae None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.332036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add9e68-9c2c-4521-bfd2-edad525d24ae None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.332415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add9e68-9c2c-4521-bfd2-edad525d24ae None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.333383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add9e68-9c2c-4521-bfd2-edad525d24ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:00.333799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add9e68-9c2c-4521-bfd2-edad525d24ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:00.335357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add9e68-9c2c-4521-bfd2-edad525d24ae None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:00.360461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 294/595] 10.222.0.112 () {56 vars in 1144 bytes} [Fri Jun 3 16:14:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:00.360461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add9e68-9c2c-4521-bfd2-edad525d24ae None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:00.370013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:00.380345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cce67-f2d7-42a3-8bea-8cc795aee859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:00.381302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cce67-f2d7-42a3-8bea-8cc795aee859 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.381585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cce67-f2d7-42a3-8bea-8cc795aee859 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.381870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cce67-f2d7-42a3-8bea-8cc795aee859 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.382719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cce67-f2d7-42a3-8bea-8cc795aee859 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:00.383349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cce67-f2d7-42a3-8bea-8cc795aee859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:00.384569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cce67-f2d7-42a3-8bea-8cc795aee859 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:00.403734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 302/596] 10.222.0.112 () {56 vars in 1142 bytes} [Fri Jun 3 16:14:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:00.405581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60116220-b4db-4435-a262-6e4bfad1aef5 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.405869 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60116220-b4db-4435-a262-6e4bfad1aef5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.406147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60116220-b4db-4435-a262-6e4bfad1aef5 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.411481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 303/597] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:00.411481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60116220-b4db-4435-a262-6e4bfad1aef5 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:00.437107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:00.481049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add9e68-9c2c-4521-bfd2-edad525d24ae None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:00.518630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60116220-b4db-4435-a262-6e4bfad1aef5 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:00.520637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dcadb-0b2e-4af0-8c8b-8d21c9fae189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:00.521651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dcadb-0b2e-4af0-8c8b-8d21c9fae189 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.521937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dcadb-0b2e-4af0-8c8b-8d21c9fae189 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.522215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dcadb-0b2e-4af0-8c8b-8d21c9fae189 None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/3a650b8d49ad480bb1620209a8b7c6e9/roles/32d5f0d8a0564b0286e98637266edf11` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.538633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dcadb-0b2e-4af0-8c8b-8d21c9fae189 None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=3a650b8d49ad480bb1620209a8b7c6e9, role_id=32d5f0d8a0564b0286e98637266edf11)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:00.540155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dcadb-0b2e-4af0-8c8b-8d21c9fae189 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:00.563583 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 295/598] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:14:00 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/3a650b8d49ad480bb1620209a8b7c6e9/roles/32d5f0d8a0564b0286e98637266edf11 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:14:00.563583 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dcadb-0b2e-4af0-8c8b-8d21c9fae189 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:00.565218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e742033-96f2-4634-8dc5-35a452ea282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:00.566192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742033-96f2-4634-8dc5-35a452ea282d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.566532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742033-96f2-4634-8dc5-35a452ea282d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.566890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742033-96f2-4634-8dc5-35a452ea282d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.582358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e742033-96f2-4634-8dc5-35a452ea282d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:00.584983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e742033-96f2-4634-8dc5-35a452ea282d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-2e742033-96f2-4634-8dc5-35a452ea282d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:00.610990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:00.612009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:00.612934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:00.612934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:00.612934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:00.612934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:00.612934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 304/599] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:00.614123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959fe9-9a6a-4227-aba6-1f98fde3388e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.614655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959fe9-9a6a-4227-aba6-1f98fde3388e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.616505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959fe9-9a6a-4227-aba6-1f98fde3388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.633966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a9959fe9-9a6a-4227-aba6-1f98fde3388e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:00.635397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a9959fe9-9a6a-4227-aba6-1f98fde3388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:00.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:00.710259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dcadb-0b2e-4af0-8c8b-8d21c9fae189 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:00.727543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 305/600] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:00.728775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959fe9-9a6a-4227-aba6-1f98fde3388e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:00.729521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:00.759749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45df0b-f144-47d0-8c3d-2abc0b5f157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:00.760586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45df0b-f144-47d0-8c3d-2abc0b5f157d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.760876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45df0b-f144-47d0-8c3d-2abc0b5f157d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.761159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45df0b-f144-47d0-8c3d-2abc0b5f157d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.784495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45df0b-f144-47d0-8c3d-2abc0b5f157d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:00.786162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45df0b-f144-47d0-8c3d-2abc0b5f157d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8a45df0b-f144-47d0-8c3d-2abc0b5f157d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:00.806673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:00.807869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:00.808990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:00.808990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:00.808990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:00.808990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:00.808990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 296/601] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:00.809337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45df0b-f144-47d0-8c3d-2abc0b5f157d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:00.855423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959fe9-9a6a-4227-aba6-1f98fde3388e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:00.903588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401070d-df5d-4d14-a9b0-c40a779ad7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:00.904830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401070d-df5d-4d14-a9b0-c40a779ad7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.905238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401070d-df5d-4d14-a9b0-c40a779ad7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.905881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401070d-df5d-4d14-a9b0-c40a779ad7b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:00.906720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401070d-df5d-4d14-a9b0-c40a779ad7b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:00.907367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401070d-df5d-4d14-a9b0-c40a779ad7b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:00.909807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401070d-df5d-4d14-a9b0-c40a779ad7b7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:00.926223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 306/602] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:00.927087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401070d-df5d-4d14-a9b0-c40a779ad7b7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:00.931141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45df0b-f144-47d0-8c3d-2abc0b5f157d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:00.962447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:00.983360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc318-0da1-41ff-ad77-04b158294510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:00.984882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc318-0da1-41ff-ad77-04b158294510 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:00.985176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc318-0da1-41ff-ad77-04b158294510 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:00.985459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc318-0da1-41ff-ad77-04b158294510 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.001195 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bc318-0da1-41ff-ad77-04b158294510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-378bc318-0da1-41ff-ad77-04b158294510 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:01.012066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:01.013815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:01.014859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 297/603] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:01.015895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc318-0da1-41ff-ad77-04b158294510 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.045221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401070d-df5d-4d14-a9b0-c40a779ad7b7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:01.050244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:01.085987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3887f-fc65-4026-a427-5bdf3819c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:01.086871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3887f-fc65-4026-a427-5bdf3819c505 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:01.087249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3887f-fc65-4026-a427-5bdf3819c505 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:01.088064 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3887f-fc65-4026-a427-5bdf3819c505 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.088722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3887f-fc65-4026-a427-5bdf3819c505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:01.089156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3887f-fc65-4026-a427-5bdf3819c505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:01.090623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3887f-fc65-4026-a427-5bdf3819c505 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:01.109247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 307/604] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:01.110075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3887f-fc65-4026-a427-5bdf3819c505 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.145859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc318-0da1-41ff-ad77-04b158294510 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:01.199504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44526d1-a45a-44f0-b855-74fb82fba016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:01.200803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44526d1-a45a-44f0-b855-74fb82fba016 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:01.201438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44526d1-a45a-44f0-b855-74fb82fba016 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:01.202064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44526d1-a45a-44f0-b855-74fb82fba016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.212828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44526d1-a45a-44f0-b855-74fb82fba016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:01.214499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44526d1-a45a-44f0-b855-74fb82fba016 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:01.220195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e44526d1-a45a-44f0-b855-74fb82fba016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:01.235381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:01.236546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:01.237607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:01.237607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:01.237607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:01.237607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:01.237607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:01.237607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:01.237607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:01.237607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:01.238931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3887f-fc65-4026-a427-5bdf3819c505 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:01.240357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 298/605] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:01.245923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44526d1-a45a-44f0-b855-74fb82fba016 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.286259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd42d8-6585-4f62-ab62-241d7e52d2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:01.287226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd42d8-6585-4f62-ab62-241d7e52d2ac None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:01.287685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd42d8-6585-4f62-ab62-241d7e52d2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:01.288126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd42d8-6585-4f62-ab62-241d7e52d2ac None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.289036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd42d8-6585-4f62-ab62-241d7e52d2ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:01.289489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd42d8-6585-4f62-ab62-241d7e52d2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:01.291587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd42d8-6585-4f62-ab62-241d7e52d2ac None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:01.303963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 308/606] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:14:01 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:01.305795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd42d8-6585-4f62-ab62-241d7e52d2ac None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.353834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:01.376701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44526d1-a45a-44f0-b855-74fb82fba016 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:01.416063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce377591-380d-47ed-bdd1-1e78616324e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:01.417433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce377591-380d-47ed-bdd1-1e78616324e6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:01.417879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce377591-380d-47ed-bdd1-1e78616324e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:01.418305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce377591-380d-47ed-bdd1-1e78616324e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.428380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce377591-380d-47ed-bdd1-1e78616324e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:01.430622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce377591-380d-47ed-bdd1-1e78616324e6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:01.441206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd42d8-6585-4f62-ab62-241d7e52d2ac None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ce377591-380d-47ed-bdd1-1e78616324e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:01.450352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:01.451479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:01.452542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:01.452542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:01.452542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:01.452542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:01.452542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:01.452542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:01.452542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:01.452542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:01.455823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 299/607] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:01.456900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce377591-380d-47ed-bdd1-1e78616324e6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.500068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba8d9f-7997-4ee0-8521-5d340fe2424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:01.501554 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba8d9f-7997-4ee0-8521-5d340fe2424a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:01.501955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba8d9f-7997-4ee0-8521-5d340fe2424a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:01.502422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba8d9f-7997-4ee0-8521-5d340fe2424a None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.504490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba8d9f-7997-4ee0-8521-5d340fe2424a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:01.505035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba8d9f-7997-4ee0-8521-5d340fe2424a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:01.507324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba8d9f-7997-4ee0-8521-5d340fe2424a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:01.524702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 309/608] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:01.529047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba8d9f-7997-4ee0-8521-5d340fe2424a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.542795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:01.589920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce377591-380d-47ed-bdd1-1e78616324e6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:01.627289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabfe96-374c-4d7a-b1b3-84e4c2a6b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:01.628177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabfe96-374c-4d7a-b1b3-84e4c2a6b29d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:01.628542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabfe96-374c-4d7a-b1b3-84e4c2a6b29d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:01.628913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabfe96-374c-4d7a-b1b3-84e4c2a6b29d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.638759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba8d9f-7997-4ee0-8521-5d340fe2424a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:01.640673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabfe96-374c-4d7a-b1b3-84e4c2a6b29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:01.642322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabfe96-374c-4d7a-b1b3-84e4c2a6b29d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:01.645049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-fbabfe96-374c-4d7a-b1b3-84e4c2a6b29d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:01.662962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:01.664151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:01.665279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:01.665279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:01.665279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:01.665279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:01.666883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 300/609] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:01.667915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabfe96-374c-4d7a-b1b3-84e4c2a6b29d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.680513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de311e38-978f-47db-b5ae-82e8c5c62897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:01.681427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de311e38-978f-47db-b5ae-82e8c5c62897 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:01.681998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de311e38-978f-47db-b5ae-82e8c5c62897 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:01.682444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de311e38-978f-47db-b5ae-82e8c5c62897 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.683425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de311e38-978f-47db-b5ae-82e8c5c62897 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:01.683898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de311e38-978f-47db-b5ae-82e8c5c62897 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:01.685736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de311e38-978f-47db-b5ae-82e8c5c62897 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:01.699567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 310/610] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:01.700753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de311e38-978f-47db-b5ae-82e8c5c62897 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.777109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:01.783574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabfe96-374c-4d7a-b1b3-84e4c2a6b29d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:01.814803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de311e38-978f-47db-b5ae-82e8c5c62897 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:01.822933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b77b-1399-475c-a618-ab29bc6b410d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:01.823829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b77b-1399-475c-a618-ab29bc6b410d None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:01.824175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b77b-1399-475c-a618-ab29bc6b410d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:01.824523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b77b-1399-475c-a618-ab29bc6b410d None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/ed487d7f2dde42268c57a5330b6c5b23/roles/32d5f0d8a0564b0286e98637266edf11` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.842897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1b77b-1399-475c-a618-ab29bc6b410d None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=ed487d7f2dde42268c57a5330b6c5b23, role_id=32d5f0d8a0564b0286e98637266edf11)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:01.844528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1b77b-1399-475c-a618-ab29bc6b410d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:01.858331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e306d9-a8db-4f2b-b321-50939bf45cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:01.859982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e306d9-a8db-4f2b-b321-50939bf45cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:01.860469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e306d9-a8db-4f2b-b321-50939bf45cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:01.860966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e306d9-a8db-4f2b-b321-50939bf45cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:01.862010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e306d9-a8db-4f2b-b321-50939bf45cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:01.862515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e306d9-a8db-4f2b-b321-50939bf45cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:01.864431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e306d9-a8db-4f2b-b321-50939bf45cb2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:01.868071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 301/611] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:14:01 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/ed487d7f2dde42268c57a5330b6c5b23/roles/32d5f0d8a0564b0286e98637266edf11 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:14:01.869084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b77b-1399-475c-a618-ab29bc6b410d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.882052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 311/612] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:01.887624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e306d9-a8db-4f2b-b321-50939bf45cb2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:01.972295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:02.033566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e306d9-a8db-4f2b-b321-50939bf45cb2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:02.074824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bcb64-dfca-4d51-8cef-53a614cf1981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:02.077148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bcb64-dfca-4d51-8cef-53a614cf1981 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:02.077584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bcb64-dfca-4d51-8cef-53a614cf1981 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:02.078036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bcb64-dfca-4d51-8cef-53a614cf1981 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:02.082929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b77b-1399-475c-a618-ab29bc6b410d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:02.087831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:02.088498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bcb64-dfca-4d51-8cef-53a614cf1981 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:02.092125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bcb64-dfca-4d51-8cef-53a614cf1981 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-af4bcb64-dfca-4d51-8cef-53a614cf1981 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:02.130794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:02.132044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:02.133261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:02.135979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 312/613] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:02.141970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bcb64-dfca-4d51-8cef-53a614cf1981 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:02.173674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb8787-04ec-47f9-9b85-680da64fe8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:02.175281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb8787-04ec-47f9-9b85-680da64fe8fa None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:02.176366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb8787-04ec-47f9-9b85-680da64fe8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:02.176818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb8787-04ec-47f9-9b85-680da64fe8fa None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/8571493023904002bd334e74441d134d/roles/32d5f0d8a0564b0286e98637266edf11` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:02.214857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb8787-04ec-47f9-9b85-680da64fe8fa None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=8571493023904002bd334e74441d134d, role_id=32d5f0d8a0564b0286e98637266edf11)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:02.218270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb8787-04ec-47f9-9b85-680da64fe8fa None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:02.237380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 302/614] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:14:01 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/8571493023904002bd334e74441d134d/roles/32d5f0d8a0564b0286e98637266edf11 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:14:02.318832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bcb64-dfca-4d51-8cef-53a614cf1981 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:02.365876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c10cb-a7cf-41f2-903c-463e0d164e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:02.366617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c10cb-a7cf-41f2-903c-463e0d164e46 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:02.366899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c10cb-a7cf-41f2-903c-463e0d164e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:02.367231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c10cb-a7cf-41f2-903c-463e0d164e46 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:02.368121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c10cb-a7cf-41f2-903c-463e0d164e46 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:02.368434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c10cb-a7cf-41f2-903c-463e0d164e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:02.369920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c10cb-a7cf-41f2-903c-463e0d164e46 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:02.401117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 313/615] 10.222.0.112 () {56 vars in 1140 bytes} [Fri Jun 3 16:14:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:02.406911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb8787-04ec-47f9-9b85-680da64fe8fa None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:02.542714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:02.552867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0938b7-4104-4c29-8d51-cac1f50a346b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:02.553153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0938b7-4104-4c29-8d51-cac1f50a346b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:02.553562 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0938b7-4104-4c29-8d51-cac1f50a346b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:02.554975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 314/616] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:02.555424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb8787-04ec-47f9-9b85-680da64fe8fa None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:02.560997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6419483-499e-404b-9ff6-0e8c90f1cb2a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:02.561282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6419483-499e-404b-9ff6-0e8c90f1cb2a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:02.561564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6419483-499e-404b-9ff6-0e8c90f1cb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:02.594449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e6419483-499e-404b-9ff6-0e8c90f1cb2a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:02.595690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e6419483-499e-404b-9ff6-0e8c90f1cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:02.598032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189643d-dc7a-45a4-a443-03dafc651f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:02.598847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189643d-dc7a-45a4-a443-03dafc651f37 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:02.599130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189643d-dc7a-45a4-a443-03dafc651f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:02.599401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189643d-dc7a-45a4-a443-03dafc651f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:02.613121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189643d-dc7a-45a4-a443-03dafc651f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:02.616524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d189643d-dc7a-45a4-a443-03dafc651f37 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d189643d-dc7a-45a4-a443-03dafc651f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:02.638519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:02.639698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:02.640812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:02.640812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:02.640812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:02.640812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:02.640812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 303/617] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:02.645596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189643d-dc7a-45a4-a443-03dafc651f37 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:02.657138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:02.709336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 315/618] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:02.759538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6419483-499e-404b-9ff6-0e8c90f1cb2a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:02.816668 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189643d-dc7a-45a4-a443-03dafc651f37 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:02.897631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4441c2-f7a7-4d25-9898-b2edf23897aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:02.898354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4441c2-f7a7-4d25-9898-b2edf23897aa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:02.898639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4441c2-f7a7-4d25-9898-b2edf23897aa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:02.898914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4441c2-f7a7-4d25-9898-b2edf23897aa None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:02.899670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4441c2-f7a7-4d25-9898-b2edf23897aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:02.899982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4441c2-f7a7-4d25-9898-b2edf23897aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:02.901384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4441c2-f7a7-4d25-9898-b2edf23897aa None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:02.926435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 304/619] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:02.931974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4441c2-f7a7-4d25-9898-b2edf23897aa None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:02.956051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:02.957068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6419483-499e-404b-9ff6-0e8c90f1cb2a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:03.032031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af11e9-259a-478e-b4af-86ea82a7ef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:03.032946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af11e9-259a-478e-b4af-86ea82a7ef22 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.033231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af11e9-259a-478e-b4af-86ea82a7ef22 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.033508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af11e9-259a-478e-b4af-86ea82a7ef22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.047118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af11e9-259a-478e-b4af-86ea82a7ef22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:03.053077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4441c2-f7a7-4d25-9898-b2edf23897aa None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-14af11e9-259a-478e-b4af-86ea82a7ef22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:03.055496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:03.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:03.057357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 316/620] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:03.058846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268bf49-3b05-4234-8173-8abad87fca80 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.058846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268bf49-3b05-4234-8173-8abad87fca80 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.059587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268bf49-3b05-4234-8173-8abad87fca80 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.061382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 317/621] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:03.066737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b9929-a583-4b90-96f6-15b220f51ffe None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.067026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b9929-a583-4b90-96f6-15b220f51ffe None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.067307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b9929-a583-4b90-96f6-15b220f51ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.085964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-920b9929-a583-4b90-96f6-15b220f51ffe None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:03.087164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-920b9929-a583-4b90-96f6-15b220f51ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:03.121900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:03.126150 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a1b8-460b-4068-a9f7-37c4d459270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:03.127728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a1b8-460b-4068-a9f7-37c4d459270a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.128311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a1b8-460b-4068-a9f7-37c4d459270a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.128932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40a1b8-460b-4068-a9f7-37c4d459270a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.137549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a1b8-460b-4068-a9f7-37c4d459270a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:03.139786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40a1b8-460b-4068-a9f7-37c4d459270a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1e40a1b8-460b-4068-a9f7-37c4d459270a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:03.158640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:03.159729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:03.160670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:03.160670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:03.160670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:03.160670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:03.160670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:03.160670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:03.160670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:03.160670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:03.163117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 305/622] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:03.164340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a1b8-460b-4068-a9f7-37c4d459270a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:03.195697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 318/623] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:14:03.195697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b9929-a583-4b90-96f6-15b220f51ffe None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:03.265417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:03.304956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40a1b8-460b-4068-a9f7-37c4d459270a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:03.334296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b9929-a583-4b90-96f6-15b220f51ffe None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:03.344494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531eb758-d1c8-4736-8d20-0b11ca730ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:03.345454 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531eb758-d1c8-4736-8d20-0b11ca730ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.345876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531eb758-d1c8-4736-8d20-0b11ca730ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.346329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531eb758-d1c8-4736-8d20-0b11ca730ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.347256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531eb758-d1c8-4736-8d20-0b11ca730ac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:03.347726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531eb758-d1c8-4736-8d20-0b11ca730ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:03.349352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531eb758-d1c8-4736-8d20-0b11ca730ac6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:03.359711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 306/624] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:14:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:03.360831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531eb758-d1c8-4736-8d20-0b11ca730ac6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:03.376223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c5ab7-b9ec-4910-931c-f4d3ec506c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:03.377011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c5ab7-b9ec-4910-931c-f4d3ec506c5d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.377401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c5ab7-b9ec-4910-931c-f4d3ec506c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.377785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c5ab7-b9ec-4910-931c-f4d3ec506c5d None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.378698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c5ab7-b9ec-4910-931c-f4d3ec506c5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:03.379100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c5ab7-b9ec-4910-931c-f4d3ec506c5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:03.380725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c5ab7-b9ec-4910-931c-f4d3ec506c5d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:03.398162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 319/625] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:03.399526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c5ab7-b9ec-4910-931c-f4d3ec506c5d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:03.428583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:03.474041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531eb758-d1c8-4736-8d20-0b11ca730ac6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:03.503505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c5ab7-b9ec-4910-931c-f4d3ec506c5d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:03.505481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:03.513638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f60d9-5db7-4c85-807a-c9b5ad1c0bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:03.514794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f60d9-5db7-4c85-807a-c9b5ad1c0bed None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.515220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f60d9-5db7-4c85-807a-c9b5ad1c0bed None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.515815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f60d9-5db7-4c85-807a-c9b5ad1c0bed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.529239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f60d9-5db7-4c85-807a-c9b5ad1c0bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-744f60d9-5db7-4c85-807a-c9b5ad1c0bed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:03.538097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:03.539232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:03.540226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:03.547415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 307/626] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:03.547415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f60d9-5db7-4c85-807a-c9b5ad1c0bed None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:03.550785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf0fd-a356-4be2-9ebb-a7817dfe16e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:03.551603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf0fd-a356-4be2-9ebb-a7817dfe16e6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.551887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf0fd-a356-4be2-9ebb-a7817dfe16e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.552160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf0fd-a356-4be2-9ebb-a7817dfe16e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.563613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf0fd-a356-4be2-9ebb-a7817dfe16e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:03.565065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf0fd-a356-4be2-9ebb-a7817dfe16e6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-1e4cf0fd-a356-4be2-9ebb-a7817dfe16e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:03.583926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:03.586752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:03.588615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:03.588615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:03.588615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:03.588615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:03.590728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 320/627] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:03.591451 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf0fd-a356-4be2-9ebb-a7817dfe16e6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:03.680773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f60d9-5db7-4c85-807a-c9b5ad1c0bed None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:03.683274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:03.705907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf0fd-a356-4be2-9ebb-a7817dfe16e6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:03.724399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888c30b-da14-4dda-9509-880ad75d130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:03.725818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888c30b-da14-4dda-9509-880ad75d130d None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.726409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888c30b-da14-4dda-9509-880ad75d130d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.726890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888c30b-da14-4dda-9509-880ad75d130d None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/f8e7179f5fe945f4be1ca16263042b3f/roles/32d5f0d8a0564b0286e98637266edf11` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.743843 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928ff1-c1b1-43e7-9ea7-1ef2873cb617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:03.744522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928ff1-c1b1-43e7-9ea7-1ef2873cb617 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:03.744809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928ff1-c1b1-43e7-9ea7-1ef2873cb617 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:03.745087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928ff1-c1b1-43e7-9ea7-1ef2873cb617 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:03.745850 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11928ff1-c1b1-43e7-9ea7-1ef2873cb617 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:03.746158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11928ff1-c1b1-43e7-9ea7-1ef2873cb617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:03.746975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888c30b-da14-4dda-9509-880ad75d130d None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=f8e7179f5fe945f4be1ca16263042b3f, role_id=32d5f0d8a0564b0286e98637266edf11)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:03.748165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11928ff1-c1b1-43e7-9ea7-1ef2873cb617 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:03.749658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888c30b-da14-4dda-9509-880ad75d130d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:03.759872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 321/628] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:14:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:03.759872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928ff1-c1b1-43e7-9ea7-1ef2873cb617 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:03.779582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 308/629] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:14:03 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/f8e7179f5fe945f4be1ca16263042b3f/roles/32d5f0d8a0564b0286e98637266edf11 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:14:03.779582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888c30b-da14-4dda-9509-880ad75d130d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:03.882125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:03.988575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888c30b-da14-4dda-9509-880ad75d130d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:04.011722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928ff1-c1b1-43e7-9ea7-1ef2873cb617 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:04.042517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6d374-148a-4326-8b04-95c77b1900ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:04.043481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6d374-148a-4326-8b04-95c77b1900ca None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.043910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6d374-148a-4326-8b04-95c77b1900ca None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.044908 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6d374-148a-4326-8b04-95c77b1900ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.056629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909d476-2157-4473-8cf9-f17834e6772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:04.056878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6d374-148a-4326-8b04-95c77b1900ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:04.057691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909d476-2157-4473-8cf9-f17834e6772d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.058137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909d476-2157-4473-8cf9-f17834e6772d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.058558 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909d476-2157-4473-8cf9-f17834e6772d None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.058833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6d374-148a-4326-8b04-95c77b1900ca None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:04.059747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909d476-2157-4473-8cf9-f17834e6772d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:04.060271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909d476-2157-4473-8cf9-f17834e6772d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:04.061814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909d476-2157-4473-8cf9-f17834e6772d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:04.075087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 322/630] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:04.081226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909d476-2157-4473-8cf9-f17834e6772d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c5c6d374-148a-4326-8b04-95c77b1900ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:04.083129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:04.084278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:04.085413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:04.085413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:04.085413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:04.085413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:04.091629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 309/631] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:04.094262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:04.096743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6d374-148a-4326-8b04-95c77b1900ca None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:04.203964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:04.219707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909d476-2157-4473-8cf9-f17834e6772d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:04.219943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6d374-148a-4326-8b04-95c77b1900ca None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:04.257499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa4442-52b6-4f2a-aeb7-e45f1caaf4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:04.258222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4442-52b6-4f2a-aeb7-e45f1caaf4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.258503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4442-52b6-4f2a-aeb7-e45f1caaf4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.258778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa4442-52b6-4f2a-aeb7-e45f1caaf4f9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.267185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa4442-52b6-4f2a-aeb7-e45f1caaf4f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:04.268691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa4442-52b6-4f2a-aeb7-e45f1caaf4f9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-23aa4442-52b6-4f2a-aeb7-e45f1caaf4f9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:04.285141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:04.286173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:04.288161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 323/632] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:04.292189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa4442-52b6-4f2a-aeb7-e45f1caaf4f9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:04.348321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612c4a7-a281-4858-9d9a-9e9da87478dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:04.349008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612c4a7-a281-4858-9d9a-9e9da87478dc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.349293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612c4a7-a281-4858-9d9a-9e9da87478dc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.349577 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612c4a7-a281-4858-9d9a-9e9da87478dc None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.350319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612c4a7-a281-4858-9d9a-9e9da87478dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:04.350631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612c4a7-a281-4858-9d9a-9e9da87478dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:04.352062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612c4a7-a281-4858-9d9a-9e9da87478dc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:04.365481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:04.373235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 310/633] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:04.380589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612c4a7-a281-4858-9d9a-9e9da87478dc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:04.396640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa4442-52b6-4f2a-aeb7-e45f1caaf4f9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:04.431937 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad098c26-72d3-49a0-9f02-19246ea235af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:04.432678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad098c26-72d3-49a0-9f02-19246ea235af None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.432969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad098c26-72d3-49a0-9f02-19246ea235af None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.433245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad098c26-72d3-49a0-9f02-19246ea235af None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.434088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad098c26-72d3-49a0-9f02-19246ea235af None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:04.434398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad098c26-72d3-49a0-9f02-19246ea235af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:04.435917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad098c26-72d3-49a0-9f02-19246ea235af None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:04.454785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 324/634] 10.222.0.112 () {56 vars in 1142 bytes} [Fri Jun 3 16:14:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:04.460256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad098c26-72d3-49a0-9f02-19246ea235af None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:04.539491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612c4a7-a281-4858-9d9a-9e9da87478dc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:04.586544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77591845-adaa-44a7-82fe-84120954b18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:04.587370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77591845-adaa-44a7-82fe-84120954b18f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.590239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77591845-adaa-44a7-82fe-84120954b18f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.590579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77591845-adaa-44a7-82fe-84120954b18f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.604770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad098c26-72d3-49a0-9f02-19246ea235af None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:04.608967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77591845-adaa-44a7-82fe-84120954b18f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:04.610474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77591845-adaa-44a7-82fe-84120954b18f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:04.632852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-77591845-adaa-44a7-82fe-84120954b18f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:04.644248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:04.645283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:04.646248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 311/635] 10.222.0.112 () {56 vars in 1098 bytes} [Fri Jun 3 16:14:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:04.651601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77591845-adaa-44a7-82fe-84120954b18f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:04.657914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380dcd-da49-41ad-aa7d-6631202e0b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:04.658563 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380dcd-da49-41ad-aa7d-6631202e0b3b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.658839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380dcd-da49-41ad-aa7d-6631202e0b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.659113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380dcd-da49-41ad-aa7d-6631202e0b3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.689810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:04.773517 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380dcd-da49-41ad-aa7d-6631202e0b3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:04.774981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380dcd-da49-41ad-aa7d-6631202e0b3b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:04.827020 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77591845-adaa-44a7-82fe-84120954b18f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:04.862625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d338de1-9a58-4cc0-8546-f63b8b1f055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:04.863311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d338de1-9a58-4cc0-8546-f63b8b1f055b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.863896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d338de1-9a58-4cc0-8546-f63b8b1f055b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.864275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d338de1-9a58-4cc0-8546-f63b8b1f055b None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.865242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d338de1-9a58-4cc0-8546-f63b8b1f055b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:04.865715 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d338de1-9a58-4cc0-8546-f63b8b1f055b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:04.867473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d338de1-9a58-4cc0-8546-f63b8b1f055b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:04.893145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 312/636] 10.222.0.112 () {56 vars in 1138 bytes} [Fri Jun 3 16:14:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:04.894576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d338de1-9a58-4cc0-8546-f63b8b1f055b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:04.945457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 325/637] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:14:04.946973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b68905-f60d-49a4-883f-8d13b1bf1f8c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.947293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b68905-f60d-49a4-883f-8d13b1bf1f8c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.947538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b68905-f60d-49a4-883f-8d13b1bf1f8c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.949240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 326/638] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:04.957521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10765ff0-77f4-490f-8e57-0fab7ea4413c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:04.957915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10765ff0-77f4-490f-8e57-0fab7ea4413c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:04.958298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10765ff0-77f4-490f-8e57-0fab7ea4413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:04.978400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:04.979689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-10765ff0-77f4-490f-8e57-0fab7ea4413c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:04.981325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-10765ff0-77f4-490f-8e57-0fab7ea4413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:04.998385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:05.019355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d338de1-9a58-4cc0-8546-f63b8b1f055b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:05.058528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97b49d-4fdf-40d5-b6ba-a2ee5c808103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:05.059175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97b49d-4fdf-40d5-b6ba-a2ee5c808103 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.059452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97b49d-4fdf-40d5-b6ba-a2ee5c808103 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.060488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97b49d-4fdf-40d5-b6ba-a2ee5c808103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.084451 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 327/639] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:05.085606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10765ff0-77f4-490f-8e57-0fab7ea4413c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:05.151438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97b49d-4fdf-40d5-b6ba-a2ee5c808103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:05.152979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97b49d-4fdf-40d5-b6ba-a2ee5c808103 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:05.205534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10765ff0-77f4-490f-8e57-0fab7ea4413c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:05.236634 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:05.253885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de90d17-0dbb-43c9-912b-43394fe54ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:05.254679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de90d17-0dbb-43c9-912b-43394fe54ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.254960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de90d17-0dbb-43c9-912b-43394fe54ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.255236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de90d17-0dbb-43c9-912b-43394fe54ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.269045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de90d17-0dbb-43c9-912b-43394fe54ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:05.270538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de90d17-0dbb-43c9-912b-43394fe54ff9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:05.278111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 313/640] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:14:05.280273 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657304-7160-400c-bc44-824d4bce25dc None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.280661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657304-7160-400c-bc44-824d4bce25dc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.281043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657304-7160-400c-bc44-824d4bce25dc None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.282615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 314/641] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:05.287592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b657304-7160-400c-bc44-824d4bce25dc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-8de90d17-0dbb-43c9-912b-43394fe54ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:05.295251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:05.296215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:05.302247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:05.302247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:05.302247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:05.302247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:05.302247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 328/642] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:05.302247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de90d17-0dbb-43c9-912b-43394fe54ff9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:05.305072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:05.417658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de90d17-0dbb-43c9-912b-43394fe54ff9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:05.418820 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b657304-7160-400c-bc44-824d4bce25dc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:05.460516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f13178-7ba0-43d3-816d-011e40fd6cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:05.461309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f13178-7ba0-43d3-816d-011e40fd6cda None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.461587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f13178-7ba0-43d3-816d-011e40fd6cda None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.461857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f13178-7ba0-43d3-816d-011e40fd6cda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.467934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd755a-cc58-41c2-824c-d457e1936b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:05.469468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd755a-cc58-41c2-824c-d457e1936b17 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.470075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd755a-cc58-41c2-824c-d457e1936b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.470676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd755a-cc58-41c2-824c-d457e1936b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.473443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f13178-7ba0-43d3-816d-011e40fd6cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f9f13178-7ba0-43d3-816d-011e40fd6cda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:05.481414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:05.483143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:05.484134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:05.490847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 315/643] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:05.490847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd16f4-cc67-40f2-8f41-26a07c25c843 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.490847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd16f4-cc67-40f2-8f41-26a07c25c843 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.490847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd16f4-cc67-40f2-8f41-26a07c25c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.491359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd755a-cc58-41c2-824c-d457e1936b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:05.494227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd755a-cc58-41c2-824c-d457e1936b17 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:05.508229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-06dd16f4-cc67-40f2-8f41-26a07c25c843 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:05.509541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-06dd16f4-cc67-40f2-8f41-26a07c25c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-60fd755a-cc58-41c2-824c-d457e1936b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:05.522353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:05.523741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:05.525112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:05.525112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:05.525112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:05.525112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:05.525592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 329/644] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:05.526220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd755a-cc58-41c2-824c-d457e1936b17 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:05.543092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:05.586254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:05.595463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 316/645] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:05.596428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd16f4-cc67-40f2-8f41-26a07c25c843 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:05.646404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd755a-cc58-41c2-824c-d457e1936b17 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:05.685481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8c31-0d8c-4816-979f-26b9676146e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:05.686069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8c31-0d8c-4816-979f-26b9676146e7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.686362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8c31-0d8c-4816-979f-26b9676146e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.686647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8c31-0d8c-4816-979f-26b9676146e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.687386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b8c31-0d8c-4816-979f-26b9676146e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:05.687748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b8c31-0d8c-4816-979f-26b9676146e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:05.689135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b8c31-0d8c-4816-979f-26b9676146e7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:05.705433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 330/646] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:05.705433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8c31-0d8c-4816-979f-26b9676146e7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:05.713008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd16f4-cc67-40f2-8f41-26a07c25c843 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:05.751030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f92c4-9d99-4d00-831e-772582f2b7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:05.751739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f92c4-9d99-4d00-831e-772582f2b7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.752026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f92c4-9d99-4d00-831e-772582f2b7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.752305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f92c4-9d99-4d00-831e-772582f2b7c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.753056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f92c4-9d99-4d00-831e-772582f2b7c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:05.753480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f92c4-9d99-4d00-831e-772582f2b7c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:05.755170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f92c4-9d99-4d00-831e-772582f2b7c1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:05.764606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 317/647] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:14:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:05.765354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f92c4-9d99-4d00-831e-772582f2b7c1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:05.791772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:05.812051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8c31-0d8c-4816-979f-26b9676146e7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:05.826318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:05.849648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070fe4c-e1e6-42fc-bd4a-d85cad06b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:05.851307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070fe4c-e1e6-42fc-bd4a-d85cad06b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.851307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070fe4c-e1e6-42fc-bd4a-d85cad06b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.851307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070fe4c-e1e6-42fc-bd4a-d85cad06b1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.851861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070fe4c-e1e6-42fc-bd4a-d85cad06b1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:05.852239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070fe4c-e1e6-42fc-bd4a-d85cad06b1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:05.853682 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070fe4c-e1e6-42fc-bd4a-d85cad06b1c3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:05.867987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 331/648] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:05.868826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070fe4c-e1e6-42fc-bd4a-d85cad06b1c3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:05.878493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f92c4-9d99-4d00-831e-772582f2b7c1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:05.915276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298b840-e4f7-4cdc-808f-d73aa1fc7a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:05.916219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298b840-e4f7-4cdc-808f-d73aa1fc7a87 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:05.916588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298b840-e4f7-4cdc-808f-d73aa1fc7a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:05.916936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298b840-e4f7-4cdc-808f-d73aa1fc7a87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:05.928124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298b840-e4f7-4cdc-808f-d73aa1fc7a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f298b840-e4f7-4cdc-808f-d73aa1fc7a87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:05.936070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:05.937055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 318/649] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:05.938475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298b840-e4f7-4cdc-808f-d73aa1fc7a87 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:05.983535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070fe4c-e1e6-42fc-bd4a-d85cad06b1c3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.020952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10597fb0-101f-466e-bff1-bc4c5a2214a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.021784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10597fb0-101f-466e-bff1-bc4c5a2214a0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.022358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10597fb0-101f-466e-bff1-bc4c5a2214a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.022637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10597fb0-101f-466e-bff1-bc4c5a2214a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.024878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:06.032014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10597fb0-101f-466e-bff1-bc4c5a2214a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.034167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10597fb0-101f-466e-bff1-bc4c5a2214a0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.048557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298b840-e4f7-4cdc-808f-d73aa1fc7a87 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-10597fb0-101f-466e-bff1-bc4c5a2214a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:06.049990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:06.051152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 332/650] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:06.052199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10597fb0-101f-466e-bff1-bc4c5a2214a0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.095058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a10176-94fd-45d1-8d3b-869ba81b012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.096052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a10176-94fd-45d1-8d3b-869ba81b012f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.096431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a10176-94fd-45d1-8d3b-869ba81b012f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.096821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a10176-94fd-45d1-8d3b-869ba81b012f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.098948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:06.109618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a10176-94fd-45d1-8d3b-869ba81b012f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.111176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a10176-94fd-45d1-8d3b-869ba81b012f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-49a10176-94fd-45d1-8d3b-869ba81b012f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:06.135648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:06.136646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:06.137547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:06.137547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:06.137547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:06.137547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:06.137547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 319/651] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:06.138601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a10176-94fd-45d1-8d3b-869ba81b012f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.186998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10597fb0-101f-466e-bff1-bc4c5a2214a0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.223875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5640-95ba-435e-bd15-d376ee272d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.224887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5640-95ba-435e-bd15-d376ee272d6e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.225223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5640-95ba-435e-bd15-d376ee272d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.225671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5640-95ba-435e-bd15-d376ee272d6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.233951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d5640-95ba-435e-bd15-d376ee272d6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.235785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d5640-95ba-435e-bd15-d376ee272d6e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b43d5640-95ba-435e-bd15-d376ee272d6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:06.251338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:06.252521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:06.253723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:06.253723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:06.253723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:06.253723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:06.253723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:06.253723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:06.253723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:06.253723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:06.254431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 333/652] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:06.259841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5640-95ba-435e-bd15-d376ee272d6e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.275181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a10176-94fd-45d1-8d3b-869ba81b012f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.312788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3be85-44c3-4e41-ae2d-c7b0c062f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.313712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3be85-44c3-4e41-ae2d-c7b0c062f30d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.313953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3be85-44c3-4e41-ae2d-c7b0c062f30d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.314297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3be85-44c3-4e41-ae2d-c7b0c062f30d None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.315116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3be85-44c3-4e41-ae2d-c7b0c062f30d None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:06.315496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3be85-44c3-4e41-ae2d-c7b0c062f30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.316988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3be85-44c3-4e41-ae2d-c7b0c062f30d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.318441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:06.326911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 320/653] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:06.331946 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3be85-44c3-4e41-ae2d-c7b0c062f30d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.364778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:06.373433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5640-95ba-435e-bd15-d376ee272d6e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.409776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d7fcc-2526-4f34-b392-9c9b2190edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.410432 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7fcc-2526-4f34-b392-9c9b2190edc4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.410715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7fcc-2526-4f34-b392-9c9b2190edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.410992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d7fcc-2526-4f34-b392-9c9b2190edc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.411836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d7fcc-2526-4f34-b392-9c9b2190edc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:06.412144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d7fcc-2526-4f34-b392-9c9b2190edc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.413579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d7fcc-2526-4f34-b392-9c9b2190edc4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.425190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 334/654] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:06.425982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d7fcc-2526-4f34-b392-9c9b2190edc4 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.442258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3be85-44c3-4e41-ae2d-c7b0c062f30d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.476270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8823e1-01c5-4d0e-96da-55ead6dad673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.476657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8823e1-01c5-4d0e-96da-55ead6dad673 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.477196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8823e1-01c5-4d0e-96da-55ead6dad673 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.477196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8823e1-01c5-4d0e-96da-55ead6dad673 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.477933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8823e1-01c5-4d0e-96da-55ead6dad673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:06.478242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8823e1-01c5-4d0e-96da-55ead6dad673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.479680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8823e1-01c5-4d0e-96da-55ead6dad673 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.491504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 321/655] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:06.492336 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8823e1-01c5-4d0e-96da-55ead6dad673 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.525297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d7fcc-2526-4f34-b392-9c9b2190edc4 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.549996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:06.560670 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99178e44-bd26-4dcc-8904-42151e3f41fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.561388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99178e44-bd26-4dcc-8904-42151e3f41fa None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.561616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99178e44-bd26-4dcc-8904-42151e3f41fa None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.561894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99178e44-bd26-4dcc-8904-42151e3f41fa None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.562680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99178e44-bd26-4dcc-8904-42151e3f41fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:06.562993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99178e44-bd26-4dcc-8904-42151e3f41fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.564473 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99178e44-bd26-4dcc-8904-42151e3f41fa None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.581189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 335/656] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:06.581189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c7222-c68b-41a2-bbd6-a30f0343b1dd None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.581189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c7222-c68b-41a2-bbd6-a30f0343b1dd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.581189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c7222-c68b-41a2-bbd6-a30f0343b1dd None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.581189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 336/657] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:06.581189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c7222-c68b-41a2-bbd6-a30f0343b1dd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.596311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:06.602778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8823e1-01c5-4d0e-96da-55ead6dad673 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.636881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a34e4b-99d7-48d9-88a0-5e5bfb4cd2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.638212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a34e4b-99d7-48d9-88a0-5e5bfb4cd2fd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.638491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a34e4b-99d7-48d9-88a0-5e5bfb4cd2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.638761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a34e4b-99d7-48d9-88a0-5e5bfb4cd2fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.649026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a34e4b-99d7-48d9-88a0-5e5bfb4cd2fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.650473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a34e4b-99d7-48d9-88a0-5e5bfb4cd2fd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c7a34e4b-99d7-48d9-88a0-5e5bfb4cd2fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:06.668701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:06.670663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:06.672548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:06.672548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:06.672548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:06.672548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:06.672548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 322/658] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:06.672548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a34e4b-99d7-48d9-88a0-5e5bfb4cd2fd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.687496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c7222-c68b-41a2-bbd6-a30f0343b1dd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.721938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b17ba-9372-4a89-ae54-7dec91bdfb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.722537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b17ba-9372-4a89-ae54-7dec91bdfb0d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.722819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b17ba-9372-4a89-ae54-7dec91bdfb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.723092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b17ba-9372-4a89-ae54-7dec91bdfb0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.723947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b17ba-9372-4a89-ae54-7dec91bdfb0d None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=5f440bbc0414415186ae83d9fa3842bd) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:06.724255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b17ba-9372-4a89-ae54-7dec91bdfb0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.725686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b17ba-9372-4a89-ae54-7dec91bdfb0d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.732024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 337/659] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/role_assignments?user.id=5f440bbc0414415186ae83d9fa3842bd&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 610 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:06.732790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b17ba-9372-4a89-ae54-7dec91bdfb0d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.779855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a34e4b-99d7-48d9-88a0-5e5bfb4cd2fd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.791194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:06.822827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c54951-3db8-44dd-b2c1-176cf5e63f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.823689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c54951-3db8-44dd-b2c1-176cf5e63f25 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.823972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c54951-3db8-44dd-b2c1-176cf5e63f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.824250 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c54951-3db8-44dd-b2c1-176cf5e63f25 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.832778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c54951-3db8-44dd-b2c1-176cf5e63f25 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.834292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c54951-3db8-44dd-b2c1-176cf5e63f25 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.839672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f4c54951-3db8-44dd-b2c1-176cf5e63f25 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:06.852003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:06.853083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:06.854104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 323/660] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:06.854724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a36b-8ec2-47e8-bb25-1cd9337a9747 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.854803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a36b-8ec2-47e8-bb25-1cd9337a9747 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.856028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a36b-8ec2-47e8-bb25-1cd9337a9747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.872808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b17ba-9372-4a89-ae54-7dec91bdfb0d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:06.873060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2e48a36b-8ec2-47e8-bb25-1cd9337a9747 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:06.874268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2e48a36b-8ec2-47e8-bb25-1cd9337a9747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:06.911884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f4cb-2e62-4ba9-8768-ca48e7989590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:06.912577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f4cb-2e62-4ba9-8768-ca48e7989590 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:06.912836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f4cb-2e62-4ba9-8768-ca48e7989590 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:06.913109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f4cb-2e62-4ba9-8768-ca48e7989590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:06.913957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f4cb-2e62-4ba9-8768-ca48e7989590 None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=3a650b8d49ad480bb1620209a8b7c6e9) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:06.914263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f4cb-2e62-4ba9-8768-ca48e7989590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:06.915750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f4cb-2e62-4ba9-8768-ca48e7989590 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:06.928225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 338/661] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/role_assignments?user.id=3a650b8d49ad480bb1620209a8b7c6e9&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 610 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:06.928225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f4cb-2e62-4ba9-8768-ca48e7989590 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:06.963507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 324/662] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:06.966253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48a36b-8ec2-47e8-bb25-1cd9337a9747 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:07.081733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f4cb-2e62-4ba9-8768-ca48e7989590 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:07.104376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:07.112020 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48a36b-8ec2-47e8-bb25-1cd9337a9747 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:07.120854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39daa54-1985-4f7a-b4f7-0fd2b9574a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:07.121530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39daa54-1985-4f7a-b4f7-0fd2b9574a5d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:07.121809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39daa54-1985-4f7a-b4f7-0fd2b9574a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:07.122653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39daa54-1985-4f7a-b4f7-0fd2b9574a5d None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:07.123400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39daa54-1985-4f7a-b4f7-0fd2b9574a5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:07.123735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39daa54-1985-4f7a-b4f7-0fd2b9574a5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:07.125144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39daa54-1985-4f7a-b4f7-0fd2b9574a5d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:07.138486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 339/663] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:07.139345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39daa54-1985-4f7a-b4f7-0fd2b9574a5d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:07.153392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:07.166253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a08b85-3bdb-4771-8d04-0add1eac53af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:07.166943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a08b85-3bdb-4771-8d04-0add1eac53af None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:07.167224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a08b85-3bdb-4771-8d04-0add1eac53af None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:07.167500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a08b85-3bdb-4771-8d04-0add1eac53af None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:07.169530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a08b85-3bdb-4771-8d04-0add1eac53af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:07.169849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a08b85-3bdb-4771-8d04-0add1eac53af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:07.171620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a08b85-3bdb-4771-8d04-0add1eac53af None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:07.200320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 325/664] 10.222.0.112 () {56 vars in 1144 bytes} [Fri Jun 3 16:14:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:07.201221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a08b85-3bdb-4771-8d04-0add1eac53af None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:07.286340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39daa54-1985-4f7a-b4f7-0fd2b9574a5d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:07.327315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e91257-d853-43e9-9bc6-1b5ff9e4b9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:07.328434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e91257-d853-43e9-9bc6-1b5ff9e4b9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:07.328872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e91257-d853-43e9-9bc6-1b5ff9e4b9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:07.329328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e91257-d853-43e9-9bc6-1b5ff9e4b9a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:07.330185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a08b85-3bdb-4771-8d04-0add1eac53af None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:07.346181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e91257-d853-43e9-9bc6-1b5ff9e4b9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-00e91257-d853-43e9-9bc6-1b5ff9e4b9a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:07.354878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:07.356109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:07.357716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:07.364915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 340/665] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:07.366382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e91257-d853-43e9-9bc6-1b5ff9e4b9a7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:07.371419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9779bd0-6c2e-4378-8cc4-6b1e892140c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:07.373157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9779bd0-6c2e-4378-8cc4-6b1e892140c9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:07.373540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9779bd0-6c2e-4378-8cc4-6b1e892140c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:07.373914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9779bd0-6c2e-4378-8cc4-6b1e892140c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:07.382738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9779bd0-6c2e-4378-8cc4-6b1e892140c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:07.384444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9779bd0-6c2e-4378-8cc4-6b1e892140c9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f9779bd0-6c2e-4378-8cc4-6b1e892140c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:07.400923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:07.402137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 16:14:07.403350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:07.406873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 326/666] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:07.406873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9779bd0-6c2e-4378-8cc4-6b1e892140c9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:07.438134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:07.457047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:07.508477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e91257-d853-43e9-9bc6-1b5ff9e4b9a7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:07.547588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7c87b-4b58-4537-9233-e682715d20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:07.548412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7c87b-4b58-4537-9233-e682715d20e8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:07.549655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7c87b-4b58-4537-9233-e682715d20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:07.550053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7c87b-4b58-4537-9233-e682715d20e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:07.600556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9779bd0-6c2e-4378-8cc4-6b1e892140c9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:07.639429 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921660ab-bf02-496b-9270-17d28d613dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:07.640270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7c87b-4b58-4537-9233-e682715d20e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:07.640419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921660ab-bf02-496b-9270-17d28d613dde None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:07.640750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921660ab-bf02-496b-9270-17d28d613dde None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:07.641125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921660ab-bf02-496b-9270-17d28d613dde None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:07.641984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921660ab-bf02-496b-9270-17d28d613dde None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:07.642391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921660ab-bf02-496b-9270-17d28d613dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:07.642659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7c87b-4b58-4537-9233-e682715d20e8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:07.644047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921660ab-bf02-496b-9270-17d28d613dde None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:07.655139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 327/667] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:14:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:07.656210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921660ab-bf02-496b-9270-17d28d613dde None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:07.711907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:07.752850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:07.762588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 341/668] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:14:07.763752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7c87b-4b58-4537-9233-e682715d20e8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:07.779891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921660ab-bf02-496b-9270-17d28d613dde None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:07.818759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071be664-55ad-4d90-9d7f-640022796cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:07.820040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be664-55ad-4d90-9d7f-640022796cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:07.820950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be664-55ad-4d90-9d7f-640022796cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:07.821582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be664-55ad-4d90-9d7f-640022796cc6 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:07.822985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be664-55ad-4d90-9d7f-640022796cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:07.823494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be664-55ad-4d90-9d7f-640022796cc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:07.825630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be664-55ad-4d90-9d7f-640022796cc6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:07.851666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 328/669] 10.222.0.112 () {56 vars in 1142 bytes} [Fri Jun 3 16:14:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:07.852849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071be664-55ad-4d90-9d7f-640022796cc6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:07.882958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7c87b-4b58-4537-9233-e682715d20e8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:07.923704 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8c0a-cdda-45de-acae-9b9939e893f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:07.925505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8c0a-cdda-45de-acae-9b9939e893f2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:07.926018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8c0a-cdda-45de-acae-9b9939e893f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:07.926681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8c0a-cdda-45de-acae-9b9939e893f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:07.941146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8c0a-cdda-45de-acae-9b9939e893f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:07.943321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a8c0a-cdda-45de-acae-9b9939e893f2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b40a8c0a-cdda-45de-acae-9b9939e893f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:07.966825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:07.968412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:07.969859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:07.969859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:07.969859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:07.969859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:07.971030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 342/670] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:07.972121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8c0a-cdda-45de-acae-9b9939e893f2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:07.978452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071be664-55ad-4d90-9d7f-640022796cc6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:07.990406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:08.029613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c3399-eb79-456f-9e7e-fb2523370f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:08.030952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c3399-eb79-456f-9e7e-fb2523370f58 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:08.031383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c3399-eb79-456f-9e7e-fb2523370f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:08.031829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c3399-eb79-456f-9e7e-fb2523370f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:08.035703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:08.049828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c3399-eb79-456f-9e7e-fb2523370f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:08.051876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c3399-eb79-456f-9e7e-fb2523370f58 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-800c3399-eb79-456f-9e7e-fb2523370f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:08.078784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:08.079920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:08.080905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:08.080905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:08.080905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:08.080905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:08.082823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 329/671] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:08.084543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c3399-eb79-456f-9e7e-fb2523370f58 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:08.098516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8c0a-cdda-45de-acae-9b9939e893f2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:08.139868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ab7c-21b6-4ec4-be5c-f4be385b1aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:08.140730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ab7c-21b6-4ec4-be5c-f4be385b1aef None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:08.141121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ab7c-21b6-4ec4-be5c-f4be385b1aef None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:08.141504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650ab7c-21b6-4ec4-be5c-f4be385b1aef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:08.227491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c3399-eb79-456f-9e7e-fb2523370f58 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:08.250396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650ab7c-21b6-4ec4-be5c-f4be385b1aef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:08.252083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650ab7c-21b6-4ec4-be5c-f4be385b1aef None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:08.273361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685661a-b0b7-4fd3-a397-39ad84c8a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:08.274219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685661a-b0b7-4fd3-a397-39ad84c8a8bd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:08.274608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685661a-b0b7-4fd3-a397-39ad84c8a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:08.274989 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685661a-b0b7-4fd3-a397-39ad84c8a8bd None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:08.275294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:08.276430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685661a-b0b7-4fd3-a397-39ad84c8a8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:08.277009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685661a-b0b7-4fd3-a397-39ad84c8a8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:08.278791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685661a-b0b7-4fd3-a397-39ad84c8a8bd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:08.291905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 330/672] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:08.293163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685661a-b0b7-4fd3-a397-39ad84c8a8bd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:08.345941 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:08.391738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 343/673] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:14:08.393219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ab7c-21b6-4ec4-be5c-f4be385b1aef None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:08.408186 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685661a-b0b7-4fd3-a397-39ad84c8a8bd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:08.445191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80375344-6d2b-4ffe-9c74-1df91ff5c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:08.446001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80375344-6d2b-4ffe-9c74-1df91ff5c7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:08.446812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80375344-6d2b-4ffe-9c74-1df91ff5c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:08.446812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80375344-6d2b-4ffe-9c74-1df91ff5c7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:08.447543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80375344-6d2b-4ffe-9c74-1df91ff5c7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:08.448013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80375344-6d2b-4ffe-9c74-1df91ff5c7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:08.449536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80375344-6d2b-4ffe-9c74-1df91ff5c7c6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:08.463466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 331/674] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:08.464638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80375344-6d2b-4ffe-9c74-1df91ff5c7c6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:08.521026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650ab7c-21b6-4ec4-be5c-f4be385b1aef None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:08.537811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:08.569286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546611a-f171-47cd-9ac5-cfa23f15d5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:08.570326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546611a-f171-47cd-9ac5-cfa23f15d5ca None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:08.570711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546611a-f171-47cd-9ac5-cfa23f15d5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:08.571106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546611a-f171-47cd-9ac5-cfa23f15d5ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:08.581042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546611a-f171-47cd-9ac5-cfa23f15d5ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:08.582838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546611a-f171-47cd-9ac5-cfa23f15d5ca None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:08.596149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80375344-6d2b-4ffe-9c74-1df91ff5c7c6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5546611a-f171-47cd-9ac5-cfa23f15d5ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:08.600434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:08.601550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:08.602692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:08.604780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 344/675] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:08.605735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546611a-f171-47cd-9ac5-cfa23f15d5ca None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:08.613333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:08.642151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a14d6e-c090-42e6-a3b0-05022e6844eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:08.642857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a14d6e-c090-42e6-a3b0-05022e6844eb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:08.643139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a14d6e-c090-42e6-a3b0-05022e6844eb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:08.643406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a14d6e-c090-42e6-a3b0-05022e6844eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:08.654935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a14d6e-c090-42e6-a3b0-05022e6844eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:08.656486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a14d6e-c090-42e6-a3b0-05022e6844eb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-90a14d6e-c090-42e6-a3b0-05022e6844eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:08.676364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:08.677372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:08.678295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:08.678295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:08.678295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:08.678295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:08.682251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 332/676] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:08.683529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a14d6e-c090-42e6-a3b0-05022e6844eb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:08.729830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546611a-f171-47cd-9ac5-cfa23f15d5ca None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:08.770303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948482f4-6af5-48e3-a786-8069497be651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:08.771645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948482f4-6af5-48e3-a786-8069497be651 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:08.772198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948482f4-6af5-48e3-a786-8069497be651 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:08.772689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948482f4-6af5-48e3-a786-8069497be651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:08.781089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948482f4-6af5-48e3-a786-8069497be651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:08.783105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948482f4-6af5-48e3-a786-8069497be651 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:08.797522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a14d6e-c090-42e6-a3b0-05022e6844eb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-948482f4-6af5-48e3-a786-8069497be651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:08.803744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:08.804684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:08.805602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:08.805602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:08.805602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:08.805602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:08.805602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:08.805602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:08.805602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:08.805602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:08.808464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 345/677] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:08.810613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948482f4-6af5-48e3-a786-8069497be651 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:08.851385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:08.852796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6ebb-0b45-4223-b265-5b326e3a155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:08.855211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6ebb-0b45-4223-b265-5b326e3a155d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:08.857096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6ebb-0b45-4223-b265-5b326e3a155d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:08.857551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6ebb-0b45-4223-b265-5b326e3a155d None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:08.858569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad6ebb-0b45-4223-b265-5b326e3a155d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:08.859039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad6ebb-0b45-4223-b265-5b326e3a155d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:08.860718 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad6ebb-0b45-4223-b265-5b326e3a155d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:08.888870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 333/678] 10.222.0.112 () {56 vars in 1140 bytes} [Fri Jun 3 16:14:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:08.890026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6ebb-0b45-4223-b265-5b326e3a155d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:08.921108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:08.961032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948482f4-6af5-48e3-a786-8069497be651 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:09.002625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996f856-f32d-45c2-9a28-0bd7520b974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:09.003544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996f856-f32d-45c2-9a28-0bd7520b974b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.003544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996f856-f32d-45c2-9a28-0bd7520b974b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.003893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996f856-f32d-45c2-9a28-0bd7520b974b None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.004583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996f856-f32d-45c2-9a28-0bd7520b974b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:09.004889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996f856-f32d-45c2-9a28-0bd7520b974b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:09.006293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996f856-f32d-45c2-9a28-0bd7520b974b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:09.030243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 346/679] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:09.032133 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996f856-f32d-45c2-9a28-0bd7520b974b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:09.036385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6ebb-0b45-4223-b265-5b326e3a155d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:09.079002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb5380-ce1b-4a31-81d4-b88c7f3405c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:09.080360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb5380-ce1b-4a31-81d4-b88c7f3405c2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.080897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb5380-ce1b-4a31-81d4-b88c7f3405c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.081395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb5380-ce1b-4a31-81d4-b88c7f3405c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.082655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb5380-ce1b-4a31-81d4-b88c7f3405c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:09.083181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb5380-ce1b-4a31-81d4-b88c7f3405c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:09.085694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb5380-ce1b-4a31-81d4-b88c7f3405c2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:09.103348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 334/680] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:09.104676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb5380-ce1b-4a31-81d4-b88c7f3405c2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:09.179987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:09.191655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996f856-f32d-45c2-9a28-0bd7520b974b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:09.225445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:09.247473 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d712d2-6a54-4020-8606-fb46af2b6c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:09.249116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d712d2-6a54-4020-8606-fb46af2b6c11 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.249681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d712d2-6a54-4020-8606-fb46af2b6c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.250134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d712d2-6a54-4020-8606-fb46af2b6c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.255133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb5380-ce1b-4a31-81d4-b88c7f3405c2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:09.295980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab781e-29c5-4379-a09e-73044db1570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:09.296800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab781e-29c5-4379-a09e-73044db1570b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.297087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab781e-29c5-4379-a09e-73044db1570b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.297367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab781e-29c5-4379-a09e-73044db1570b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.305836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab781e-29c5-4379-a09e-73044db1570b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:09.307673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab781e-29c5-4379-a09e-73044db1570b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-89ab781e-29c5-4379-a09e-73044db1570b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:09.323042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:09.324202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:09.325695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:09.325695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:09.325695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:09.325695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:09.325695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:09.325695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:09.325695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:09.325695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:09.329615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 335/681] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:09.330480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab781e-29c5-4379-a09e-73044db1570b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:09.337550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d712d2-6a54-4020-8606-fb46af2b6c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:09.338964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d712d2-6a54-4020-8606-fb46af2b6c11 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:09.445319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:09.452626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab781e-29c5-4379-a09e-73044db1570b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:09.456441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 347/682] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:14:09.457783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066faf2-620c-4c87-ad38-27705d10aa37 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.458068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066faf2-620c-4c87-ad38-27705d10aa37 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.458341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066faf2-620c-4c87-ad38-27705d10aa37 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.460686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 348/683] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:09.460686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066faf2-620c-4c87-ad38-27705d10aa37 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:09.496716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea8184-0ccd-4aa6-9324-5aba4d72799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:09.498117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea8184-0ccd-4aa6-9324-5aba4d72799d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.498561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea8184-0ccd-4aa6-9324-5aba4d72799d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.498969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea8184-0ccd-4aa6-9324-5aba4d72799d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.500031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea8184-0ccd-4aa6-9324-5aba4d72799d None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=ed487d7f2dde42268c57a5330b6c5b23) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:09.500445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea8184-0ccd-4aa6-9324-5aba4d72799d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:09.502285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea8184-0ccd-4aa6-9324-5aba4d72799d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:09.509584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 336/684] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:09 2022] GET /identity/v3/role_assignments?user.id=ed487d7f2dde42268c57a5330b6c5b23&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 610 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:09.511223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a27b23-c226-4468-ba1e-0db57a6cf857 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.511515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a27b23-c226-4468-ba1e-0db57a6cf857 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.511828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a27b23-c226-4468-ba1e-0db57a6cf857 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.513377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 337/685] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:09.515484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a27b23-c226-4468-ba1e-0db57a6cf857 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:09.518491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:09.601155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066faf2-620c-4c87-ad38-27705d10aa37 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:09.649719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e062-95f4-44d9-8bdd-e9470d444b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:09.650895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e062-95f4-44d9-8bdd-e9470d444b50 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.651394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e062-95f4-44d9-8bdd-e9470d444b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.651886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a27b23-c226-4468-ba1e-0db57a6cf857 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:09.652346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e062-95f4-44d9-8bdd-e9470d444b50 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.653501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553e062-95f4-44d9-8bdd-e9470d444b50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:09.654078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553e062-95f4-44d9-8bdd-e9470d444b50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:09.657070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553e062-95f4-44d9-8bdd-e9470d444b50 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:09.682090 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 349/686] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:09.684106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315811c6-3192-49ab-82da-d33f0eee7691 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.685206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315811c6-3192-49ab-82da-d33f0eee7691 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.685723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315811c6-3192-49ab-82da-d33f0eee7691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.705694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384eada-c9da-470f-9572-d34c306273d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:09.707016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384eada-c9da-470f-9572-d34c306273d0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.707496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384eada-c9da-470f-9572-d34c306273d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.707855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384eada-c9da-470f-9572-d34c306273d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.718567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-315811c6-3192-49ab-82da-d33f0eee7691 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:09.720426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384eada-c9da-470f-9572-d34c306273d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:09.720867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-315811c6-3192-49ab-82da-d33f0eee7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:09.721928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384eada-c9da-470f-9572-d34c306273d0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3384eada-c9da-470f-9572-d34c306273d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:09.744042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:09.745509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:09.746624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:09.746624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:09.746624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:09.746624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:09.746624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 338/687] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:09.748029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a34918-8835-4bff-ae3b-79d79700b7c0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:09.748029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a34918-8835-4bff-ae3b-79d79700b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:09.748029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a34918-8835-4bff-ae3b-79d79700b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:09.768592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a3a34918-8835-4bff-ae3b-79d79700b7c0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:09.769854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a3a34918-8835-4bff-ae3b-79d79700b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:09.815607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:09.839219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 350/688] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:09.840175 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315811c6-3192-49ab-82da-d33f0eee7691 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:09.849058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:09.872670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 339/689] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:09.874054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a34918-8835-4bff-ae3b-79d79700b7c0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:10.015023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a34918-8835-4bff-ae3b-79d79700b7c0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.018905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315811c6-3192-49ab-82da-d33f0eee7691 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.062683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e30fb-640d-4289-8de9-1d9d53ac17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:10.063373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e30fb-640d-4289-8de9-1d9d53ac17ce None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:10.063711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e30fb-640d-4289-8de9-1d9d53ac17ce None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:10.064032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e30fb-640d-4289-8de9-1d9d53ac17ce None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:10.064830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e30fb-640d-4289-8de9-1d9d53ac17ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:10.065086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e30fb-640d-4289-8de9-1d9d53ac17ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:10.065532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506aaea-2057-4efa-bb6e-03b20dfaf23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:10.066226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506aaea-2057-4efa-bb6e-03b20dfaf23f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:10.066505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506aaea-2057-4efa-bb6e-03b20dfaf23f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:10.066618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e30fb-640d-4289-8de9-1d9d53ac17ce None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:10.066771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506aaea-2057-4efa-bb6e-03b20dfaf23f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:10.067719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506aaea-2057-4efa-bb6e-03b20dfaf23f None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=8571493023904002bd334e74441d134d) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:10.068100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506aaea-2057-4efa-bb6e-03b20dfaf23f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:10.069732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506aaea-2057-4efa-bb6e-03b20dfaf23f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:10.078186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 351/690] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:09 2022] GET /identity/v3/role_assignments?user.id=8571493023904002bd334e74441d134d&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 610 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:10.079041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506aaea-2057-4efa-bb6e-03b20dfaf23f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:10.091220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 340/691] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:10.092647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e30fb-640d-4289-8de9-1d9d53ac17ce None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:10.151593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:10.177287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:10.237959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506aaea-2057-4efa-bb6e-03b20dfaf23f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.259887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e30fb-640d-4289-8de9-1d9d53ac17ce None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.287275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00e439-4437-45d8-9f88-1b45e5fe2eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:10.288040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00e439-4437-45d8-9f88-1b45e5fe2eaa None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:10.288374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00e439-4437-45d8-9f88-1b45e5fe2eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:10.288679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00e439-4437-45d8-9f88-1b45e5fe2eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:10.305401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00e439-4437-45d8-9f88-1b45e5fe2eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:10.306899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00e439-4437-45d8-9f88-1b45e5fe2eaa None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:10.309145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22386-e977-4149-974c-1e0125ddb96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:10.310882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22386-e977-4149-974c-1e0125ddb96a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:10.311369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22386-e977-4149-974c-1e0125ddb96a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:10.311889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22386-e977-4149-974c-1e0125ddb96a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:10.324628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe22386-e977-4149-974c-1e0125ddb96a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-9f00e439-4437-45d8-9f88-1b45e5fe2eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:10.329646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:10.330586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:10.331496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:10.331496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:10.331496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:10.331496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:10.331496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 352/692] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:10.332227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00e439-4437-45d8-9f88-1b45e5fe2eaa None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8fe22386-e977-4149-974c-1e0125ddb96a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:10.335810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:10.336773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:10.337730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:10.340851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 341/693] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:10.342013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22386-e977-4149-974c-1e0125ddb96a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:10.473959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:10.477084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00e439-4437-45d8-9f88-1b45e5fe2eaa None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.489772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22386-e977-4149-974c-1e0125ddb96a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.492487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:10.533264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e13dd7-3f7c-469f-b9b1-50850d43696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:10.533923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da0c11-70ec-479e-85ee-0c2a20fc11be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:10.534150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e13dd7-3f7c-469f-b9b1-50850d43696f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:10.534357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e13dd7-3f7c-469f-b9b1-50850d43696f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:10.534639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e13dd7-3f7c-469f-b9b1-50850d43696f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:10.535392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da0c11-70ec-479e-85ee-0c2a20fc11be None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:10.536002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da0c11-70ec-479e-85ee-0c2a20fc11be None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:10.536501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da0c11-70ec-479e-85ee-0c2a20fc11be None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:10.537509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da0c11-70ec-479e-85ee-0c2a20fc11be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:10.538018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da0c11-70ec-479e-85ee-0c2a20fc11be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:10.539647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da0c11-70ec-479e-85ee-0c2a20fc11be None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:10.543289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e13dd7-3f7c-469f-b9b1-50850d43696f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:10.544936 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e13dd7-3f7c-469f-b9b1-50850d43696f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:10.554078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 342/694] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:10.555342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da0c11-70ec-479e-85ee-0c2a20fc11be None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-44e13dd7-3f7c-469f-b9b1-50850d43696f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:10.563789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:10.564760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:10.565660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:10.565660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:10.565660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:10.565660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:10.565660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:10.565660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:10.565660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:10.565660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:10.565660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 353/695] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:10.566616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e13dd7-3f7c-469f-b9b1-50850d43696f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:10.677240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da0c11-70ec-479e-85ee-0c2a20fc11be None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.716620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e13dd7-3f7c-469f-b9b1-50850d43696f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.718260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc98bb-a331-4d84-8cfa-d250ed1827eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:10.719154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc98bb-a331-4d84-8cfa-d250ed1827eb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:10.719686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc98bb-a331-4d84-8cfa-d250ed1827eb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:10.720160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc98bb-a331-4d84-8cfa-d250ed1827eb None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:10.721137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc98bb-a331-4d84-8cfa-d250ed1827eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:10.721642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc98bb-a331-4d84-8cfa-d250ed1827eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:10.723239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc98bb-a331-4d84-8cfa-d250ed1827eb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:10.734299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 343/696] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:10.735540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc98bb-a331-4d84-8cfa-d250ed1827eb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:10.761842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d3f5-c772-424f-aaf0-b93ca0fece20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:10.763120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d3f5-c772-424f-aaf0-b93ca0fece20 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:10.763413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d3f5-c772-424f-aaf0-b93ca0fece20 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:10.763729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d3f5-c772-424f-aaf0-b93ca0fece20 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:10.764480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d3f5-c772-424f-aaf0-b93ca0fece20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:10.767131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d3f5-c772-424f-aaf0-b93ca0fece20 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:10.769714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:10.797136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 354/697] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:14:10 2022] POST /identity/v3/users => generated 255 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:10.798305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d3f5-c772-424f-aaf0-b93ca0fece20 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:10.819202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:10.866751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc98bb-a331-4d84-8cfa-d250ed1827eb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.919840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d3f5-c772-424f-aaf0-b93ca0fece20 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:10.926658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550a2c7-f7c3-49ee-9259-28da00efcfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:10.929399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550a2c7-f7c3-49ee-9259-28da00efcfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:10.930400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550a2c7-f7c3-49ee-9259-28da00efcfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:10.931822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550a2c7-f7c3-49ee-9259-28da00efcfa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:10.933982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550a2c7-f7c3-49ee-9259-28da00efcfa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:10.934579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550a2c7-f7c3-49ee-9259-28da00efcfa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:10.937931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550a2c7-f7c3-49ee-9259-28da00efcfa7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:10.967982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 344/698] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:10.972559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550a2c7-f7c3-49ee-9259-28da00efcfa7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:11.000733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ec533-e229-4d4e-b097-9f3286f61742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:11.002146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec533-e229-4d4e-b097-9f3286f61742 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:11.002660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec533-e229-4d4e-b097-9f3286f61742 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:11.003348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec533-e229-4d4e-b097-9f3286f61742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:11.018951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ec533-e229-4d4e-b097-9f3286f61742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:11.020530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ec533-e229-4d4e-b097-9f3286f61742 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-011ec533-e229-4d4e-b097-9f3286f61742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:11.040617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:11.041580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:11.042490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:11.042490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:11.042490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:11.042490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:11.042490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 355/699] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:11.052760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ec533-e229-4d4e-b097-9f3286f61742 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:11.116657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:11.131127 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550a2c7-f7c3-49ee-9259-28da00efcfa7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:11.144575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:11.169389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d814e0-f59c-4c0f-9fe2-9afb7a544a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:11.170045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d814e0-f59c-4c0f-9fe2-9afb7a544a70 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:11.170323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d814e0-f59c-4c0f-9fe2-9afb7a544a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:11.171620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d814e0-f59c-4c0f-9fe2-9afb7a544a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:11.171620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d814e0-f59c-4c0f-9fe2-9afb7a544a70 None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=f8e7179f5fe945f4be1ca16263042b3f) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:11.171838 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d814e0-f59c-4c0f-9fe2-9afb7a544a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:11.173202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d814e0-f59c-4c0f-9fe2-9afb7a544a70 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:11.180443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 345/700] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:10 2022] GET /identity/v3/role_assignments?user.id=f8e7179f5fe945f4be1ca16263042b3f&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 610 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:11.194359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ec533-e229-4d4e-b097-9f3286f61742 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:11.238007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaededcd-c288-432c-b689-fc08328413d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:11.238957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaededcd-c288-432c-b689-fc08328413d7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:11.239394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaededcd-c288-432c-b689-fc08328413d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:11.239878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaededcd-c288-432c-b689-fc08328413d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:11.241535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaededcd-c288-432c-b689-fc08328413d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:11.242005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaededcd-c288-432c-b689-fc08328413d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:11.243596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaededcd-c288-432c-b689-fc08328413d7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:11.260585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 356/701] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:11.267609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d814e0-f59c-4c0f-9fe2-9afb7a544a70 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:11.394322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d814e0-f59c-4c0f-9fe2-9afb7a544a70 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:11.435199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191e13e-1c5d-4679-91a5-35036a65aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:11.436036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e13e-1c5d-4679-91a5-35036a65aed4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:11.436325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e13e-1c5d-4679-91a5-35036a65aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:11.437713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e13e-1c5d-4679-91a5-35036a65aed4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:11.447585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191e13e-1c5d-4679-91a5-35036a65aed4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:11.449070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191e13e-1c5d-4679-91a5-35036a65aed4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8191e13e-1c5d-4679-91a5-35036a65aed4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:11.472742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:11.473955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:11.475126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:11.477415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 346/702] 10.222.0.112 () {56 vars in 1098 bytes} [Fri Jun 3 16:14:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:11.483314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaededcd-c288-432c-b689-fc08328413d7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:11.596244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaededcd-c288-432c-b689-fc08328413d7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:11.627337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:11.636795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63b406-d490-4b67-a073-47586802313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:11.638251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63b406-d490-4b67-a073-47586802313f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:11.638643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63b406-d490-4b67-a073-47586802313f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:11.639026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63b406-d490-4b67-a073-47586802313f None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:11.640104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63b406-d490-4b67-a073-47586802313f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:11.640542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63b406-d490-4b67-a073-47586802313f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:11.642215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63b406-d490-4b67-a073-47586802313f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:11.663892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 357/703] 10.222.0.112 () {56 vars in 1138 bytes} [Fri Jun 3 16:14:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:11.669475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191e13e-1c5d-4679-91a5-35036a65aed4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:11.683745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:11.785954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191e13e-1c5d-4679-91a5-35036a65aed4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:11.819673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe71606-2322-4e99-8a2b-d1c54c4660d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:11.820322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71606-2322-4e99-8a2b-d1c54c4660d7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:11.820601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71606-2322-4e99-8a2b-d1c54c4660d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:11.820874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71606-2322-4e99-8a2b-d1c54c4660d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:11.897660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe71606-2322-4e99-8a2b-d1c54c4660d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:11.899140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe71606-2322-4e99-8a2b-d1c54c4660d7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:11.910647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:12.023812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 347/704] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:14:12.029659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63b406-d490-4b67-a073-47586802313f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:12.163946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63b406-d490-4b67-a073-47586802313f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:12.206920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e1d36-5c90-4c4c-b711-49fc974c27ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:12.207750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e1d36-5c90-4c4c-b711-49fc974c27ed None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:12.208032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e1d36-5c90-4c4c-b711-49fc974c27ed None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:12.208306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e1d36-5c90-4c4c-b711-49fc974c27ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:12.213760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ccc55-c8fb-44ee-89af-4a9442908ebf None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:12.214037 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ccc55-c8fb-44ee-89af-4a9442908ebf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:12.214304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ccc55-c8fb-44ee-89af-4a9442908ebf None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:12.216356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 348/705] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:12.223827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea604773-bcfe-4b9c-9c8a-0afc155999a0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:12.224121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea604773-bcfe-4b9c-9c8a-0afc155999a0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:12.224404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea604773-bcfe-4b9c-9c8a-0afc155999a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:12.225701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e1d36-5c90-4c4c-b711-49fc974c27ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:12.227281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e1d36-5c90-4c4c-b711-49fc974c27ed None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-874e1d36-5c90-4c4c-b711-49fc974c27ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:12.246559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:12.247631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:12.248567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:12.248567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:12.248567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:12.248567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:12.248567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 358/706] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:12.250232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ea604773-bcfe-4b9c-9c8a-0afc155999a0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:12.250337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ea604773-bcfe-4b9c-9c8a-0afc155999a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:12.253389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e1d36-5c90-4c4c-b711-49fc974c27ed None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:12.297450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:12.358843 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e1d36-5c90-4c4c-b711-49fc974c27ed None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:12.368455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 349/707] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:12.397455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764bb20-0f78-4995-9259-9ac94f828b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:12.398180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764bb20-0f78-4995-9259-9ac94f828b42 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:12.398469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764bb20-0f78-4995-9259-9ac94f828b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:12.398747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764bb20-0f78-4995-9259-9ac94f828b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:12.399480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764bb20-0f78-4995-9259-9ac94f828b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:12.399915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764bb20-0f78-4995-9259-9ac94f828b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:12.401311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764bb20-0f78-4995-9259-9ac94f828b42 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:12.413396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea604773-bcfe-4b9c-9c8a-0afc155999a0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:12.414344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 359/708] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:12.420601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764bb20-0f78-4995-9259-9ac94f828b42 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:12.495864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:12.599971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:12.607467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea604773-bcfe-4b9c-9c8a-0afc155999a0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:12.613964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764bb20-0f78-4995-9259-9ac94f828b42 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:12.661011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7377a-c793-4d29-aa59-11098cd71803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:12.661011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7377a-c793-4d29-aa59-11098cd71803 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:12.661011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7377a-c793-4d29-aa59-11098cd71803 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:12.661011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7377a-c793-4d29-aa59-11098cd71803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:12.667349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7377a-c793-4d29-aa59-11098cd71803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:12.669581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7377a-c793-4d29-aa59-11098cd71803 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:12.673616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64de65-a45e-4428-9b8e-0aa73c17b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:12.674900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64de65-a45e-4428-9b8e-0aa73c17b11c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:12.675723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64de65-a45e-4428-9b8e-0aa73c17b11c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:12.676503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64de65-a45e-4428-9b8e-0aa73c17b11c None admin] PATH_INFO: `/v3/services/network` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:12.677687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64de65-a45e-4428-9b8e-0aa73c17b11c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:12.679369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64de65-a45e-4428-9b8e-0aa73c17b11c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-cde7377a-c793-4d29-aa59-11098cd71803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:12.686229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:12.687184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:12.688172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:12.688172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:12.688172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:12.688172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:12.688172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:12.688172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:12.688172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:12.688172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:12.691972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 360/709] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:12.693338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7377a-c793-4d29-aa59-11098cd71803 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-de64de65-a45e-4428-9b8e-0aa73c17b11c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:12.714288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:12.715818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 16:14:12.716683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:12.717454 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 350/710] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:12 2022] GET /identity/v3/services/network => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:12.725379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64de65-a45e-4428-9b8e-0aa73c17b11c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:12.936905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64de65-a45e-4428-9b8e-0aa73c17b11c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:12.942855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7377a-c793-4d29-aa59-11098cd71803 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:12.945629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:13.019533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db03e3-0270-4ed7-8d37-57ed37dce7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:13.021284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db03e3-0270-4ed7-8d37-57ed37dce7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.022930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db03e3-0270-4ed7-8d37-57ed37dce7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.024846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db03e3-0270-4ed7-8d37-57ed37dce7d8 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.026781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db03e3-0270-4ed7-8d37-57ed37dce7d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:13.029301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db03e3-0270-4ed7-8d37-57ed37dce7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:13.033153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db03e3-0270-4ed7-8d37-57ed37dce7d8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:13.037994 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba50a1-0eaf-4608-9609-9f217f09356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:13.039668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba50a1-0eaf-4608-9609-9f217f09356d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.040509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba50a1-0eaf-4608-9609-9f217f09356d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.041370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba50a1-0eaf-4608-9609-9f217f09356d None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.042614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba50a1-0eaf-4608-9609-9f217f09356d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:13.045136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba50a1-0eaf-4608-9609-9f217f09356d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:13.047273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba50a1-0eaf-4608-9609-9f217f09356d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:13.051978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 351/711] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:12 2022] GET /identity/v3/services?name=network => generated 125 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:13.057569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db03e3-0270-4ed7-8d37-57ed37dce7d8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:13.073872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 361/712] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:13.080015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba50a1-0eaf-4608-9609-9f217f09356d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:13.126399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:13.258513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba50a1-0eaf-4608-9609-9f217f09356d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:13.283744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db03e3-0270-4ed7-8d37-57ed37dce7d8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:13.301719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf0723-c74f-4fdb-807c-8df0a3ceef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:13.302381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0723-c74f-4fdb-807c-8df0a3ceef34 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.302672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0723-c74f-4fdb-807c-8df0a3ceef34 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.302951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf0723-c74f-4fdb-807c-8df0a3ceef34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.303939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf0723-c74f-4fdb-807c-8df0a3ceef34 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=3a650b8d49ad480bb1620209a8b7c6e9) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:13.304258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf0723-c74f-4fdb-807c-8df0a3ceef34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:13.305794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf0723-c74f-4fdb-807c-8df0a3ceef34 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:13.312472 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 362/713] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:13 2022] GET /identity/v3/role_assignments?user.id=3a650b8d49ad480bb1620209a8b7c6e9&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:13.314101 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f54d4-2318-4458-85eb-5c31b9b1eeb1 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.314372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f54d4-2318-4458-85eb-5c31b9b1eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.314655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f54d4-2318-4458-85eb-5c31b9b1eeb1 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.323590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 363/714] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:13.326601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb68fc-62da-4c9b-b6b7-bdfadc349c27 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.326913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb68fc-62da-4c9b-b6b7-bdfadc349c27 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.327198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb68fc-62da-4c9b-b6b7-bdfadc349c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.341745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055403f-91d5-4acc-b065-424df7c59b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:13.342437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055403f-91d5-4acc-b065-424df7c59b21 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.342722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055403f-91d5-4acc-b065-424df7c59b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.342998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055403f-91d5-4acc-b065-424df7c59b21 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.343761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055403f-91d5-4acc-b065-424df7c59b21 None admin] RBAC: Adding query filter params (type=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:13.344076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055403f-91d5-4acc-b065-424df7c59b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:13.345508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055403f-91d5-4acc-b065-424df7c59b21 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:13.362203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 352/715] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:13 2022] GET /identity/v3/services?type=network => generated 125 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:13.363171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-31bb68fc-62da-4c9b-b6b7-bdfadc349c27 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:13.364447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-31bb68fc-62da-4c9b-b6b7-bdfadc349c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:13.467061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 364/716] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:13.503506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055403f-91d5-4acc-b065-424df7c59b21 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:13.549806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:13.635471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055403f-91d5-4acc-b065-424df7c59b21 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:13.673448 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d99ba3-e4b3-458d-b1ca-7bed0ff079e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:13.674270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d99ba3-e4b3-458d-b1ca-7bed0ff079e8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.674555 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d99ba3-e4b3-458d-b1ca-7bed0ff079e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.674826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d99ba3-e4b3-458d-b1ca-7bed0ff079e8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.675486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d99ba3-e4b3-458d-b1ca-7bed0ff079e8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:13.676902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d99ba3-e4b3-458d-b1ca-7bed0ff079e8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-18d99ba3-e4b3-458d-b1ca-7bed0ff079e8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:13.690617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:13.691669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:13.692529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 353/717] 10.222.0.112 () {56 vars in 1134 bytes} [Fri Jun 3 16:14:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:13.701283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb68fc-62da-4c9b-b6b7-bdfadc349c27 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:13.722575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:13.785032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7a800-fe67-4299-ac04-e67a4a24e3e0 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.785703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7a800-fe67-4299-ac04-e67a4a24e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.785703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7a800-fe67-4299-ac04-e67a4a24e3e0 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.787000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 354/718] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:13.792568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ffe36-59c4-4637-91dc-204a354b135f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.792852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ffe36-59c4-4637-91dc-204a354b135f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.793132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ffe36-59c4-4637-91dc-204a354b135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.822122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e48ffe36-59c4-4637-91dc-204a354b135f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:13.823261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e48ffe36-59c4-4637-91dc-204a354b135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:13.836212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb68fc-62da-4c9b-b6b7-bdfadc349c27 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:13.879361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2815d-fcf0-44e7-bc73-8438d58a6e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:13.880079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2815d-fcf0-44e7-bc73-8438d58a6e31 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:13.880365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2815d-fcf0-44e7-bc73-8438d58a6e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:13.880645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2815d-fcf0-44e7-bc73-8438d58a6e31 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:13.881370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2815d-fcf0-44e7-bc73-8438d58a6e31 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:13.881741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2815d-fcf0-44e7-bc73-8438d58a6e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:13.883166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2815d-fcf0-44e7-bc73-8438d58a6e31 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:13.894185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 365/719] 10.222.0.112 () {56 vars in 1129 bytes} [Fri Jun 3 16:14:13 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:13.900239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2815d-fcf0-44e7-bc73-8438d58a6e31 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:13.980440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 355/720] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:14:14.008677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:14.021004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ffe36-59c4-4637-91dc-204a354b135f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:14.033931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2815d-fcf0-44e7-bc73-8438d58a6e31 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:14.080700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae78cb-6afb-4606-abe3-b712eb3ad606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:14.081301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae78cb-6afb-4606-abe3-b712eb3ad606 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:14.081583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae78cb-6afb-4606-abe3-b712eb3ad606 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:14.081915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae78cb-6afb-4606-abe3-b712eb3ad606 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:14.082650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae78cb-6afb-4606-abe3-b712eb3ad606 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:14.082968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae78cb-6afb-4606-abe3-b712eb3ad606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:14.084693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae78cb-6afb-4606-abe3-b712eb3ad606 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:14.095922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:14.099946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 366/721] 10.222.0.112 () {56 vars in 1129 bytes} [Fri Jun 3 16:14:13 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:14.185965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ffe36-59c4-4637-91dc-204a354b135f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:14.251354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075e384-551d-4be9-a879-84e6a55cf537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:14.252211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e384-551d-4be9-a879-84e6a55cf537 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:14.252499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e384-551d-4be9-a879-84e6a55cf537 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:14.252773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075e384-551d-4be9-a879-84e6a55cf537 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:14.273710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075e384-551d-4be9-a879-84e6a55cf537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1075e384-551d-4be9-a879-84e6a55cf537 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:14.281797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:14.282830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:14.283704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 356/722] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:14.289195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae78cb-6afb-4606-abe3-b712eb3ad606 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:14.355635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ae08a-aec9-45b8-bf0f-136bdaad79dd None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:14.356356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ae08a-aec9-45b8-bf0f-136bdaad79dd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:14.357096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ae08a-aec9-45b8-bf0f-136bdaad79dd None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:14.358930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 357/723] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:14.364431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61ce2-c7f1-4b61-8861-a9861c526510 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:14.365005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61ce2-c7f1-4b61-8861-a9861c526510 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:14.365491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c61ce2-c7f1-4b61-8861-a9861c526510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:14.384821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e6c61ce2-c7f1-4b61-8861-a9861c526510 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:14.386463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e6c61ce2-c7f1-4b61-8861-a9861c526510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:14.415143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae78cb-6afb-4606-abe3-b712eb3ad606 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:14.467103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d27623-828b-4e06-bc5d-407c6bbe6cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:14.467818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d27623-828b-4e06-bc5d-407c6bbe6cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:14.468140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d27623-828b-4e06-bc5d-407c6bbe6cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:14.468374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d27623-828b-4e06-bc5d-407c6bbe6cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:14.469131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d27623-828b-4e06-bc5d-407c6bbe6cd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:14.469441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d27623-828b-4e06-bc5d-407c6bbe6cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:14.470955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d27623-828b-4e06-bc5d-407c6bbe6cd9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:14.471169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 358/724] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 16:14:14.482031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 367/725] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:14:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:14.487338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c61ce2-c7f1-4b61-8861-a9861c526510 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:14.506771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:14.510218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d27623-828b-4e06-bc5d-407c6bbe6cd9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:14.513732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:14.598233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c61ce2-c7f1-4b61-8861-a9861c526510 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:14.635053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dc9a3-59d9-48f5-85fa-8f229995e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:14.636289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dc9a3-59d9-48f5-85fa-8f229995e5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:14.636810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dc9a3-59d9-48f5-85fa-8f229995e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:14.637857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dc9a3-59d9-48f5-85fa-8f229995e5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:14.649086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7dc9a3-59d9-48f5-85fa-8f229995e5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:14.650858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7dc9a3-59d9-48f5-85fa-8f229995e5a5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:14.664272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d27623-828b-4e06-bc5d-407c6bbe6cd9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8d7dc9a3-59d9-48f5-85fa-8f229995e5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:14.689761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:14.690768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:14.692130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:14.692130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:14.692130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:14.692130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:14.696600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 359/726] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:14.702050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dc9a3-59d9-48f5-85fa-8f229995e5a5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:14.734390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcf813-17e8-4a36-8e77-0a341eca7448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:14.735181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcf813-17e8-4a36-8e77-0a341eca7448 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:14.735462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcf813-17e8-4a36-8e77-0a341eca7448 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:14.735767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcf813-17e8-4a36-8e77-0a341eca7448 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:14.751144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcf813-17e8-4a36-8e77-0a341eca7448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-4dbcf813-17e8-4a36-8e77-0a341eca7448 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:14.758827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:14.759865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:14.760733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 368/727] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:14.768533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcf813-17e8-4a36-8e77-0a341eca7448 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:14.847948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:14.881714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcf813-17e8-4a36-8e77-0a341eca7448 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:14.882320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:14.947802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dc9a3-59d9-48f5-85fa-8f229995e5a5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:14.952269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcc4c0-b5ba-4bbc-aa14-34cf038677b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:14.952955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcc4c0-b5ba-4bbc-aa14-34cf038677b7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:14.953232 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcc4c0-b5ba-4bbc-aa14-34cf038677b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:14.953503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcc4c0-b5ba-4bbc-aa14-34cf038677b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:14.954259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcc4c0-b5ba-4bbc-aa14-34cf038677b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:14.954562 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcc4c0-b5ba-4bbc-aa14-34cf038677b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:14.955969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcc4c0-b5ba-4bbc-aa14-34cf038677b7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:14.978105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 369/728] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:14.984319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcc4c0-b5ba-4bbc-aa14-34cf038677b7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:14.989486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894fa17-d0fd-4fb8-8e22-a6afd5f70741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:14.990453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894fa17-d0fd-4fb8-8e22-a6afd5f70741 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:14.990964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894fa17-d0fd-4fb8-8e22-a6afd5f70741 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:14.991453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894fa17-d0fd-4fb8-8e22-a6afd5f70741 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:14.992421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894fa17-d0fd-4fb8-8e22-a6afd5f70741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:14.992931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894fa17-d0fd-4fb8-8e22-a6afd5f70741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:14.994558 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894fa17-d0fd-4fb8-8e22-a6afd5f70741 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:15.007999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 360/729] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:15.013935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894fa17-d0fd-4fb8-8e22-a6afd5f70741 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:15.131607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894fa17-d0fd-4fb8-8e22-a6afd5f70741 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:15.167003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:15.182976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff401a1-bce8-45b7-bdfe-403707f79f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:15.184800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff401a1-bce8-45b7-bdfe-403707f79f79 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:15.185292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff401a1-bce8-45b7-bdfe-403707f79f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:15.185782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff401a1-bce8-45b7-bdfe-403707f79f79 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:15.194622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff401a1-bce8-45b7-bdfe-403707f79f79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:15.196584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff401a1-bce8-45b7-bdfe-403707f79f79 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9ff401a1-bce8-45b7-bdfe-403707f79f79 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:15.213341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:15.214319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:15.217404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:15.220130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 361/730] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:14:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:15.226140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff401a1-bce8-45b7-bdfe-403707f79f79 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:15.317729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcc4c0-b5ba-4bbc-aa14-34cf038677b7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:15.341235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff401a1-bce8-45b7-bdfe-403707f79f79 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:15.380909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c99fd9-0efb-43ea-b946-569695052f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:15.381991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c99fd9-0efb-43ea-b946-569695052f53 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:15.382481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c99fd9-0efb-43ea-b946-569695052f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:15.382962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c99fd9-0efb-43ea-b946-569695052f53 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:15.384064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c99fd9-0efb-43ea-b946-569695052f53 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:15.384581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c99fd9-0efb-43ea-b946-569695052f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:15.386809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c99fd9-0efb-43ea-b946-569695052f53 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:15.387974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:15.408986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 362/731] 10.222.0.112 () {56 vars in 1154 bytes} [Fri Jun 3 16:14:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:15.414345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c99fd9-0efb-43ea-b946-569695052f53 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:15.432323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70082302-9cd0-4944-910f-8fdb0173ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:15.433144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70082302-9cd0-4944-910f-8fdb0173ba2a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:15.433425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70082302-9cd0-4944-910f-8fdb0173ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:15.433695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70082302-9cd0-4944-910f-8fdb0173ba2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:15.456685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70082302-9cd0-4944-910f-8fdb0173ba2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:15.458158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70082302-9cd0-4944-910f-8fdb0173ba2a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:15.468823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-70082302-9cd0-4944-910f-8fdb0173ba2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:15.500122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:15.501107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:15.502041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:15.502041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:15.502041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:15.502041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:15.508148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 370/732] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 524 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:15.513381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70082302-9cd0-4944-910f-8fdb0173ba2a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:15.530830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c99fd9-0efb-43ea-b946-569695052f53 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:15.571586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300da8c-6825-459d-85e6-1204894eaf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:15.572670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300da8c-6825-459d-85e6-1204894eaf18 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:15.573194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300da8c-6825-459d-85e6-1204894eaf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:15.573678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300da8c-6825-459d-85e6-1204894eaf18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:15.648773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300da8c-6825-459d-85e6-1204894eaf18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:15.650595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300da8c-6825-459d-85e6-1204894eaf18 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:15.757187 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:15.761430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70082302-9cd0-4944-910f-8fdb0173ba2a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:15.829144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f5d47-396c-4ad6-a3b8-caf5770d961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:15.829877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f5d47-396c-4ad6-a3b8-caf5770d961c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:15.830164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f5d47-396c-4ad6-a3b8-caf5770d961c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:15.830438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f5d47-396c-4ad6-a3b8-caf5770d961c None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:15.831579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f5d47-396c-4ad6-a3b8-caf5770d961c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:15.831579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f5d47-396c-4ad6-a3b8-caf5770d961c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:15.832985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f5d47-396c-4ad6-a3b8-caf5770d961c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:15.852104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 363/733] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:15 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:14:15.855328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 371/734] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:15.857747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300da8c-6825-459d-85e6-1204894eaf18 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:15.860700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f5d47-396c-4ad6-a3b8-caf5770d961c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:15.927922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:15.992153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300da8c-6825-459d-85e6-1204894eaf18 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:16.009218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f5d47-396c-4ad6-a3b8-caf5770d961c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:16.041706 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2017a8-1252-4335-ac73-14056cd36549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:16.042497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2017a8-1252-4335-ac73-14056cd36549 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.042783 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2017a8-1252-4335-ac73-14056cd36549 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.043599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2017a8-1252-4335-ac73-14056cd36549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.050882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da359904-be22-4ee5-9ecf-4ea48cd63029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:16.051699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359904-be22-4ee5-9ecf-4ea48cd63029 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.051979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359904-be22-4ee5-9ecf-4ea48cd63029 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.052265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359904-be22-4ee5-9ecf-4ea48cd63029 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.058291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2017a8-1252-4335-ac73-14056cd36549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:16.060254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da359904-be22-4ee5-9ecf-4ea48cd63029 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:16.061159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2017a8-1252-4335-ac73-14056cd36549 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:16.061696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da359904-be22-4ee5-9ecf-4ea48cd63029 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:16.069675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-da359904-be22-4ee5-9ecf-4ea48cd63029 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:16.078475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:16.079465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:16.080480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 372/735] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:16.082652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731e430-0d8c-47f9-aef9-2bc304fe3d55 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.082652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731e430-0d8c-47f9-aef9-2bc304fe3d55 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.082652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731e430-0d8c-47f9-aef9-2bc304fe3d55 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.087293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 373/736] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:16.088105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731e430-0d8c-47f9-aef9-2bc304fe3d55 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-fd2017a8-1252-4335-ac73-14056cd36549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:16.088666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:16.089538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:16.090525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:16.090525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:16.090525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:16.090525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:16.093768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 364/737] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:16.095326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5fb3c-8043-4bd8-b33e-ce6fef7b6c11 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.095778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5fb3c-8043-4bd8-b33e-ce6fef7b6c11 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.096209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5fb3c-8043-4bd8-b33e-ce6fef7b6c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.117244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-11e5fb3c-8043-4bd8-b33e-ce6fef7b6c11 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:16.119188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-11e5fb3c-8043-4bd8-b33e-ce6fef7b6c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:16.212454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:16.223056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731e430-0d8c-47f9-aef9-2bc304fe3d55 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:16.231774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 365/738] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:16.231774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5fb3c-8043-4bd8-b33e-ce6fef7b6c11 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:16.284604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569b210-6e81-4cc1-b284-b09242344651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:16.285201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b210-6e81-4cc1-b284-b09242344651 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.285478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b210-6e81-4cc1-b284-b09242344651 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.285755 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b210-6e81-4cc1-b284-b09242344651 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.286611 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569b210-6e81-4cc1-b284-b09242344651 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:16.287029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569b210-6e81-4cc1-b284-b09242344651 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:16.288539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569b210-6e81-4cc1-b284-b09242344651 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:16.308215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 374/739] 10.222.0.112 () {56 vars in 1140 bytes} [Fri Jun 3 16:14:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:16.310017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569b210-6e81-4cc1-b284-b09242344651 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:16.339704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5fb3c-8043-4bd8-b33e-ce6fef7b6c11 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:16.372125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:16.381578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869e145-68fb-4bcb-ad63-1046bbabd0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:16.381921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869e145-68fb-4bcb-ad63-1046bbabd0aa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.382254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869e145-68fb-4bcb-ad63-1046bbabd0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.382559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869e145-68fb-4bcb-ad63-1046bbabd0aa None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.383295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869e145-68fb-4bcb-ad63-1046bbabd0aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:16.383645 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869e145-68fb-4bcb-ad63-1046bbabd0aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:16.385489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869e145-68fb-4bcb-ad63-1046bbabd0aa None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:16.397748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 366/740] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:16.397748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be74f5-e60e-4c98-b1e0-4e882b300602 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.397748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be74f5-e60e-4c98-b1e0-4e882b300602 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.397748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be74f5-e60e-4c98-b1e0-4e882b300602 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.397748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 367/741] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:16.397748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be74f5-e60e-4c98-b1e0-4e882b300602 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:16.423715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569b210-6e81-4cc1-b284-b09242344651 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:16.460412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed9641-a211-41a2-aa57-e8e3c5dd3e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:16.461204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9641-a211-41a2-aa57-e8e3c5dd3e1c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.461484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9641-a211-41a2-aa57-e8e3c5dd3e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.461755 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed9641-a211-41a2-aa57-e8e3c5dd3e1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.473549 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed9641-a211-41a2-aa57-e8e3c5dd3e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-d6ed9641-a211-41a2-aa57-e8e3c5dd3e1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:16.481358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:16.482590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 375/742] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:16.488425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed9641-a211-41a2-aa57-e8e3c5dd3e1c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:16.505387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:16.517987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be74f5-e60e-4c98-b1e0-4e882b300602 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:16.555938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265c64f-1027-40fe-a0ff-6f2b1d6f8333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:16.556551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c64f-1027-40fe-a0ff-6f2b1d6f8333 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.556838 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c64f-1027-40fe-a0ff-6f2b1d6f8333 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.557115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265c64f-1027-40fe-a0ff-6f2b1d6f8333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.599422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed9641-a211-41a2-aa57-e8e3c5dd3e1c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:16.617732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:16.633529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3fd65-bfc0-4934-bbd2-7a56db99a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:16.634318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3fd65-bfc0-4934-bbd2-7a56db99a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.634594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3fd65-bfc0-4934-bbd2-7a56db99a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.634863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3fd65-bfc0-4934-bbd2-7a56db99a7e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.635050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265c64f-1027-40fe-a0ff-6f2b1d6f8333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:16.636559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265c64f-1027-40fe-a0ff-6f2b1d6f8333 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:16.642344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3fd65-bfc0-4934-bbd2-7a56db99a7e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:16.643817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3fd65-bfc0-4934-bbd2-7a56db99a7e6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-79d3fd65-bfc0-4934-bbd2-7a56db99a7e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:16.658657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:16.659626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:16.660566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:16.660566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:16.660566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:16.660566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:16.660566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:16.660566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:16.660566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:16.660566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:16.660566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 376/743] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:16.661648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebbeff-e248-4cb2-af39-c71ecfe4686b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.661648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebbeff-e248-4cb2-af39-c71ecfe4686b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.661648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebbeff-e248-4cb2-af39-c71ecfe4686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.678023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-57ebbeff-e248-4cb2-af39-c71ecfe4686b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:16.679217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-57ebbeff-e248-4cb2-af39-c71ecfe4686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:16.748931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 368/744] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:16 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 16:14:16.749164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 377/745] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:16.759604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265c64f-1027-40fe-a0ff-6f2b1d6f8333 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:16.759824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebbeff-e248-4cb2-af39-c71ecfe4686b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:16.761950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:16.853498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:16.867018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265c64f-1027-40fe-a0ff-6f2b1d6f8333 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:16.870335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebbeff-e248-4cb2-af39-c71ecfe4686b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:16.902036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1681b-443f-4f71-8e57-d716c69ce32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:16.902723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1681b-443f-4f71-8e57-d716c69ce32f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.903012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1681b-443f-4f71-8e57-d716c69ce32f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.903293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1681b-443f-4f71-8e57-d716c69ce32f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.904069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1681b-443f-4f71-8e57-d716c69ce32f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:16.904382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1681b-443f-4f71-8e57-d716c69ce32f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:16.904500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03540e4-2522-4639-8bd5-79c20733e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:16.905042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03540e4-2522-4639-8bd5-79c20733e141 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:16.905324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03540e4-2522-4639-8bd5-79c20733e141 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:16.905597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03540e4-2522-4639-8bd5-79c20733e141 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:16.905763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1681b-443f-4f71-8e57-d716c69ce32f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:16.906380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03540e4-2522-4639-8bd5-79c20733e141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:16.906689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03540e4-2522-4639-8bd5-79c20733e141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:16.908170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03540e4-2522-4639-8bd5-79c20733e141 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:16.913966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 369/746] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:16.914973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1681b-443f-4f71-8e57-d716c69ce32f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:16.925659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 378/747] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:16.925659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03540e4-2522-4639-8bd5-79c20733e141 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:16.985203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:17.018664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1681b-443f-4f71-8e57-d716c69ce32f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:17.025634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03540e4-2522-4639-8bd5-79c20733e141 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:17.052380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e32262-e661-4bbf-b81e-35647b283662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:17.053170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e32262-e661-4bbf-b81e-35647b283662 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.053455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e32262-e661-4bbf-b81e-35647b283662 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.053730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e32262-e661-4bbf-b81e-35647b283662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.058393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c44ad2-5a0c-44ab-915f-9233e0863900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:17.059151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44ad2-5a0c-44ab-915f-9233e0863900 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.059434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44ad2-5a0c-44ab-915f-9233e0863900 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.059742 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44ad2-5a0c-44ab-915f-9233e0863900 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.060463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44ad2-5a0c-44ab-915f-9233e0863900 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:17.061821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44ad2-5a0c-44ab-915f-9233e0863900 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:17.064545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e32262-e661-4bbf-b81e-35647b283662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:17.066998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e32262-e661-4bbf-b81e-35647b283662 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:17.077238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 379/748] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:14:16 2022] POST /identity/v3/services => generated 241 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:17.078621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a3c8b-c3bd-4184-89f9-0350c3feb36b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.078916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a3c8b-c3bd-4184-89f9-0350c3feb36b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.079236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a3c8b-c3bd-4184-89f9-0350c3feb36b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.080757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 380/749] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:17.081294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a3c8b-c3bd-4184-89f9-0350c3feb36b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-64e32262-e661-4bbf-b81e-35647b283662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:17.093723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:17.094872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:17.095864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:17.095864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:17.095864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:17.095864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:17.096924 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 370/750] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:17.097210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e32262-e661-4bbf-b81e-35647b283662 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:17.102190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:17.225615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e32262-e661-4bbf-b81e-35647b283662 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:17.226383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a3c8b-c3bd-4184-89f9-0350c3feb36b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:17.252019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:17.268384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50326e13-bb1e-43bc-9d9b-26d8c5d391f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:17.269032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083d15d-b943-4fed-ad42-72ad1ffc0650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:17.269156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50326e13-bb1e-43bc-9d9b-26d8c5d391f1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.269350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50326e13-bb1e-43bc-9d9b-26d8c5d391f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.269612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50326e13-bb1e-43bc-9d9b-26d8c5d391f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.269833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083d15d-b943-4fed-ad42-72ad1ffc0650 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.270118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083d15d-b943-4fed-ad42-72ad1ffc0650 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.270398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083d15d-b943-4fed-ad42-72ad1ffc0650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.270501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50326e13-bb1e-43bc-9d9b-26d8c5d391f1 None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=9b44182e2e5b4b34bd549452c305c194) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:17.270749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50326e13-bb1e-43bc-9d9b-26d8c5d391f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:17.272985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50326e13-bb1e-43bc-9d9b-26d8c5d391f1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:17.280293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 371/751] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:17 2022] GET /identity/v3/role_assignments?user.id=9b44182e2e5b4b34bd549452c305c194&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:17.281642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d423c9e-f7cb-4da0-816e-b1019193f6c2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.281929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d423c9e-f7cb-4da0-816e-b1019193f6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.282203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d423c9e-f7cb-4da0-816e-b1019193f6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.284594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083d15d-b943-4fed-ad42-72ad1ffc0650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:17.286112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083d15d-b943-4fed-ad42-72ad1ffc0650 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:17.302627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0d423c9e-f7cb-4da0-816e-b1019193f6c2 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:17.304004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0d423c9e-f7cb-4da0-816e-b1019193f6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-e083d15d-b943-4fed-ad42-72ad1ffc0650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:17.310630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:17.311680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:17.312629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:17.312629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:17.312629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:17.312629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:17.312629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 381/752] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:17.313368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083d15d-b943-4fed-ad42-72ad1ffc0650 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:17.396667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:17.405105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 372/753] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:17 2022] POST /identity/v3/auth/tokens => generated 899 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 16:14:17.406174 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d423c9e-f7cb-4da0-816e-b1019193f6c2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:17.480485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083d15d-b943-4fed-ad42-72ad1ffc0650 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:17.519134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405873db-2176-473c-bfe9-3c98e505dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:17.519857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405873db-2176-473c-bfe9-3c98e505dab6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.520143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405873db-2176-473c-bfe9-3c98e505dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.520423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405873db-2176-473c-bfe9-3c98e505dab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.521160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405873db-2176-473c-bfe9-3c98e505dab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:17.521592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405873db-2176-473c-bfe9-3c98e505dab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:17.523002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405873db-2176-473c-bfe9-3c98e505dab6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:17.536379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d423c9e-f7cb-4da0-816e-b1019193f6c2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:17.542351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 382/754] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:17.543353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405873db-2176-473c-bfe9-3c98e505dab6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:17.578962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:17.586285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8282c5-1415-403c-8839-b55c02f2a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:17.587222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8282c5-1415-403c-8839-b55c02f2a472 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.587696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8282c5-1415-403c-8839-b55c02f2a472 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.588124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8282c5-1415-403c-8839-b55c02f2a472 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.589014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8282c5-1415-403c-8839-b55c02f2a472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:17.589501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8282c5-1415-403c-8839-b55c02f2a472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:17.592200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8282c5-1415-403c-8839-b55c02f2a472 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:17.612206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 373/755] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:17.613578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8282c5-1415-403c-8839-b55c02f2a472 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:17.662864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405873db-2176-473c-bfe9-3c98e505dab6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:17.690878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:17.715011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251df9-45c4-4f80-96de-31c213ccabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:17.716463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251df9-45c4-4f80-96de-31c213ccabda None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.716906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251df9-45c4-4f80-96de-31c213ccabda None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.717421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43251df9-45c4-4f80-96de-31c213ccabda None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.719096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251df9-45c4-4f80-96de-31c213ccabda None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:17.720985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43251df9-45c4-4f80-96de-31c213ccabda None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:17.741447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 383/756] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:14:17 2022] POST /identity/v3/services => generated 252 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:17.742682 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251df9-45c4-4f80-96de-31c213ccabda None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:17.750994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8282c5-1415-403c-8839-b55c02f2a472 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:17.872968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea057-38a3-4665-ab14-b0dfba596f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:17.873849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea057-38a3-4665-ab14-b0dfba596f53 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:17.874135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea057-38a3-4665-ab14-b0dfba596f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:17.874472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea057-38a3-4665-ab14-b0dfba596f53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:17.889101 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ea057-38a3-4665-ab14-b0dfba596f53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:17.890703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ea057-38a3-4665-ab14-b0dfba596f53 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e76ea057-38a3-4665-ab14-b0dfba596f53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:17.928560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:17.929664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:17.930590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:17.930590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:17.930590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:17.930590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:17.930590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:17.930590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:17.930590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:17.930590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:17.930590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 374/757] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:17.933815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43251df9-45c4-4f80-96de-31c213ccabda None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:17.936163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea057-38a3-4665-ab14-b0dfba596f53 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:17.946389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:18.008253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d31d7-790c-4d08-844d-45f9dde5595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:18.008932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d31d7-790c-4d08-844d-45f9dde5595b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:18.009213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d31d7-790c-4d08-844d-45f9dde5595b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:18.009490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d31d7-790c-4d08-844d-45f9dde5595b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:18.023410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d31d7-790c-4d08-844d-45f9dde5595b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:18.026365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d31d7-790c-4d08-844d-45f9dde5595b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5f2d31d7-790c-4d08-844d-45f9dde5595b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:18.046457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:18.047485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:18.048499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 384/758] 10.222.0.112 () {56 vars in 1098 bytes} [Fri Jun 3 16:14:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:18.056600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d31d7-790c-4d08-844d-45f9dde5595b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:18.115878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea057-38a3-4665-ab14-b0dfba596f53 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:18.164779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a024ed-ad49-481c-9182-c7798e5818f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:18.164779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a024ed-ad49-481c-9182-c7798e5818f9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:18.165067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a024ed-ad49-481c-9182-c7798e5818f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:18.165293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a024ed-ad49-481c-9182-c7798e5818f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:18.165967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a024ed-ad49-481c-9182-c7798e5818f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:18.166289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a024ed-ad49-481c-9182-c7798e5818f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:18.167944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a024ed-ad49-481c-9182-c7798e5818f9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:18.188039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 375/759] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:18.188253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:18.190783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d31d7-790c-4d08-844d-45f9dde5595b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:18.197608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a024ed-ad49-481c-9182-c7798e5818f9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:18.235051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ff96b-9e69-4058-a134-c78c930deacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:18.235784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ff96b-9e69-4058-a134-c78c930deacd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:18.236066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ff96b-9e69-4058-a134-c78c930deacd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:18.236340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ff96b-9e69-4058-a134-c78c930deacd None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:18.237191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ff96b-9e69-4058-a134-c78c930deacd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:18.237561 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ff96b-9e69-4058-a134-c78c930deacd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:18.239080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ff96b-9e69-4058-a134-c78c930deacd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:18.258346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 385/760] 10.222.0.112 () {56 vars in 1138 bytes} [Fri Jun 3 16:14:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:18.268070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ff96b-9e69-4058-a134-c78c930deacd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:18.280921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:18.377394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ff96b-9e69-4058-a134-c78c930deacd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:18.379815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a024ed-ad49-481c-9182-c7798e5818f9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:18.417639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65444a-7059-4eaf-9704-96b6720a34dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:18.419040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65444a-7059-4eaf-9704-96b6720a34dd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:18.419385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65444a-7059-4eaf-9704-96b6720a34dd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:18.419910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65444a-7059-4eaf-9704-96b6720a34dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:18.433087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65444a-7059-4eaf-9704-96b6720a34dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:18.435323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65444a-7059-4eaf-9704-96b6720a34dd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3a65444a-7059-4eaf-9704-96b6720a34dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:18.456496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:18.457484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:18.458405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:18.458405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:18.458405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:18.458405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:18.458405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 386/761] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:18.460975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6718f-e194-4b87-bee1-ede000157c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:18.461753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6718f-e194-4b87-bee1-ede000157c72 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:18.462110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6718f-e194-4b87-bee1-ede000157c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:18.462464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6718f-e194-4b87-bee1-ede000157c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:18.463517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6718f-e194-4b87-bee1-ede000157c72 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=f8e7179f5fe945f4be1ca16263042b3f) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:18.464192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6718f-e194-4b87-bee1-ede000157c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:18.466585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65444a-7059-4eaf-9704-96b6720a34dd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:18.475155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6718f-e194-4b87-bee1-ede000157c72 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:18.487118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 376/762] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:18 2022] GET /identity/v3/role_assignments?user.id=f8e7179f5fe945f4be1ca16263042b3f&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:18.550719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:18.594451 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65444a-7059-4eaf-9704-96b6720a34dd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:18.632279 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829e42-bcb1-46a9-8542-e355c71dca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:18.633015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829e42-bcb1-46a9-8542-e355c71dca6b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:18.633303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829e42-bcb1-46a9-8542-e355c71dca6b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:18.633579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829e42-bcb1-46a9-8542-e355c71dca6b None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:18.634330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc829e42-bcb1-46a9-8542-e355c71dca6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:18.634637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc829e42-bcb1-46a9-8542-e355c71dca6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:18.636164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc829e42-bcb1-46a9-8542-e355c71dca6b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:18.651123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 387/763] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:18.659214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6718f-e194-4b87-bee1-ede000157c72 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:18.727519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:18.821154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6718f-e194-4b87-bee1-ede000157c72 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:18.877529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e6e0a-633f-45a7-9b5f-e535e48e1f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:18.878361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e6e0a-633f-45a7-9b5f-e535e48e1f4e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:18.878650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e6e0a-633f-45a7-9b5f-e535e48e1f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:18.878936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e6e0a-633f-45a7-9b5f-e535e48e1f4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:18.892569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e6e0a-633f-45a7-9b5f-e535e48e1f4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:18.894077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e6e0a-633f-45a7-9b5f-e535e48e1f4e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-397e6e0a-633f-45a7-9b5f-e535e48e1f4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:18.913516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:18.914683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:18.916554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:18.916554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:18.916554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:18.916554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:18.916554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:18.916554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:18.916554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:18.916554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:18.916554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 377/764] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:18.921243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829e42-bcb1-46a9-8542-e355c71dca6b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:19.056613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829e42-bcb1-46a9-8542-e355c71dca6b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:19.080177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:19.093423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66a50f-d4bc-450b-916b-365c2bbec1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:19.094398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66a50f-d4bc-450b-916b-365c2bbec1bd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:19.094863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66a50f-d4bc-450b-916b-365c2bbec1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:19.095319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66a50f-d4bc-450b-916b-365c2bbec1bd None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:19.096455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66a50f-d4bc-450b-916b-365c2bbec1bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:19.096948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66a50f-d4bc-450b-916b-365c2bbec1bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:19.098573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66a50f-d4bc-450b-916b-365c2bbec1bd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:19.112756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 388/765] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:19.120597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e6e0a-633f-45a7-9b5f-e535e48e1f4e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:19.260498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:19.268392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e6e0a-633f-45a7-9b5f-e535e48e1f4e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:19.318741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f119ca-1187-440c-b5fc-addbcd849653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:19.319669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f119ca-1187-440c-b5fc-addbcd849653 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:19.319953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f119ca-1187-440c-b5fc-addbcd849653 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:19.320238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f119ca-1187-440c-b5fc-addbcd849653 None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/3a650b8d49ad480bb1620209a8b7c6e9/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:19.324018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f119ca-1187-440c-b5fc-addbcd849653 None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=3a650b8d49ad480bb1620209a8b7c6e9, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:19.326042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f119ca-1187-440c-b5fc-addbcd849653 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:19.344083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 378/766] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:14:19 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/3a650b8d49ad480bb1620209a8b7c6e9/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:14:19.850246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8491c-8209-4e9e-8ade-ae54ac153fac None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:19.850634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8491c-8209-4e9e-8ade-ae54ac153fac None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:19.850843 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8491c-8209-4e9e-8ade-ae54ac153fac None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:19.852480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 389/767] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:19.859065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e446c82-35ce-4eed-918a-aef510e22a55 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:19.859356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e446c82-35ce-4eed-918a-aef510e22a55 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:19.859661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e446c82-35ce-4eed-918a-aef510e22a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:19.877665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0e446c82-35ce-4eed-918a-aef510e22a55 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:19.878866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0e446c82-35ce-4eed-918a-aef510e22a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:19.955663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 379/768] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:19 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:19.974302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8491c-8209-4e9e-8ade-ae54ac153fac None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:20.017459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b39a7-4888-40dd-9fe3-ab3fb6400614 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.017803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b39a7-4888-40dd-9fe3-ab3fb6400614 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.018014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b39a7-4888-40dd-9fe3-ab3fb6400614 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.019671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 380/769] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:20.024487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f720a-de41-471b-8833-ccdcd6feb3ee None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.024774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f720a-de41-471b-8833-ccdcd6feb3ee None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.025053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f720a-de41-471b-8833-ccdcd6feb3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.063520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-695f720a-de41-471b-8833-ccdcd6feb3ee None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:20.066669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-695f720a-de41-471b-8833-ccdcd6feb3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:20.118222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8491c-8209-4e9e-8ade-ae54ac153fac None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:20.195255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceac615-9839-40e4-837e-a3ea5e7f7407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:20.196841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac615-9839-40e4-837e-a3ea5e7f7407 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.197125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac615-9839-40e4-837e-a3ea5e7f7407 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.197401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac615-9839-40e4-837e-a3ea5e7f7407 None admin] PATH_INFO: `/v3/services/network` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.198067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceac615-9839-40e4-837e-a3ea5e7f7407 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:20.199504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceac615-9839-40e4-837e-a3ea5e7f7407 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:20.217124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 381/770] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:20 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-dceac615-9839-40e4-837e-a3ea5e7f7407 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:20.224715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:20.225779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:20.226647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 390/771] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:19 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:20.237801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f720a-de41-471b-8833-ccdcd6feb3ee None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:20.247463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceac615-9839-40e4-837e-a3ea5e7f7407 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:20.267947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:20.333004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:20.408629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceac615-9839-40e4-837e-a3ea5e7f7407 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:20.428172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f720a-de41-471b-8833-ccdcd6feb3ee None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:20.445457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facdde2-7386-4ebe-8e87-cb343bee6fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:20.446177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facdde2-7386-4ebe-8e87-cb343bee6fad None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.446465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facdde2-7386-4ebe-8e87-cb343bee6fad None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.446796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facdde2-7386-4ebe-8e87-cb343bee6fad None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.447514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facdde2-7386-4ebe-8e87-cb343bee6fad None admin] RBAC: Adding query filter params (name=network) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:20.447847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facdde2-7386-4ebe-8e87-cb343bee6fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:20.449251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facdde2-7386-4ebe-8e87-cb343bee6fad None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:20.454616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 391/772] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:20 2022] GET /identity/v3/services?name=network => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:20.462279 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facdde2-7386-4ebe-8e87-cb343bee6fad None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:20.536855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232369c-d990-4e9a-9281-58ce1a0bfee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:20.537670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232369c-d990-4e9a-9281-58ce1a0bfee1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.537953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232369c-d990-4e9a-9281-58ce1a0bfee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.538228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232369c-d990-4e9a-9281-58ce1a0bfee1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.572834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232369c-d990-4e9a-9281-58ce1a0bfee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:20.580582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facdde2-7386-4ebe-8e87-cb343bee6fad None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5232369c-d990-4e9a-9281-58ce1a0bfee1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:20.581245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:20.582177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:20.583048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 382/773] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:20.584380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9168ff-a117-4bd9-b239-fa1e16f94e19 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.584380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9168ff-a117-4bd9-b239-fa1e16f94e19 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.584563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9168ff-a117-4bd9-b239-fa1e16f94e19 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.585965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 383/774] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:20.595575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9168ff-a117-4bd9-b239-fa1e16f94e19 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:20.601127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:20.630284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3095862-864d-4fd6-8b4c-326c0ed20eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:20.631111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095862-864d-4fd6-8b4c-326c0ed20eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.631714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095862-864d-4fd6-8b4c-326c0ed20eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.632020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3095862-864d-4fd6-8b4c-326c0ed20eb5 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.633059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095862-864d-4fd6-8b4c-326c0ed20eb5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:20.633419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095862-864d-4fd6-8b4c-326c0ed20eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:20.635578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3095862-864d-4fd6-8b4c-326c0ed20eb5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:20.642327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 392/775] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:20 2022] GET /identity/v3/services?type=network => generated 352 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:20.643711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586b652-ef6d-40c0-a345-ffbaa912c316 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.643999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586b652-ef6d-40c0-a345-ffbaa912c316 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.644276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586b652-ef6d-40c0-a345-ffbaa912c316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.667770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9586b652-ef6d-40c0-a345-ffbaa912c316 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:20.669943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9586b652-ef6d-40c0-a345-ffbaa912c316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:20.691695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:20.723225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9168ff-a117-4bd9-b239-fa1e16f94e19 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:20.756366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 393/776] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:20 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:20.757435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586b652-ef6d-40c0-a345-ffbaa912c316 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:20.784371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ce51-03db-44ae-b157-18b9c7a4d648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:20.785053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ce51-03db-44ae-b157-18b9c7a4d648 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.785339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ce51-03db-44ae-b157-18b9c7a4d648 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.786169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ce51-03db-44ae-b157-18b9c7a4d648 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.787082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48ce51-03db-44ae-b157-18b9c7a4d648 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:20.787513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48ce51-03db-44ae-b157-18b9c7a4d648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:20.789231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48ce51-03db-44ae-b157-18b9c7a4d648 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:20.803976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 384/777] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:14:20 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:20.805009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ce51-03db-44ae-b157-18b9c7a4d648 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:20.889174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586b652-ef6d-40c0-a345-ffbaa912c316 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:20.893241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:20.937512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adb5e6-11d9-4a6b-bb8b-10d2937e8e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:20.938761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adb5e6-11d9-4a6b-bb8b-10d2937e8e10 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.939595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adb5e6-11d9-4a6b-bb8b-10d2937e8e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.939988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adb5e6-11d9-4a6b-bb8b-10d2937e8e10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.940948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adb5e6-11d9-4a6b-bb8b-10d2937e8e10 None admin] RBAC: Adding query filter params (interface=public, service_id=175f2be9c82a472ea63b20781f6a38d0, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:20.941364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ce51-03db-44ae-b157-18b9c7a4d648 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:20.941476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adb5e6-11d9-4a6b-bb8b-10d2937e8e10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:20.943198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adb5e6-11d9-4a6b-bb8b-10d2937e8e10 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:20.954222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 394/778] 10.222.0.112 () {56 vars in 1256 bytes} [Fri Jun 3 16:14:20 2022] GET /identity/v3/endpoints?service_id=175f2be9c82a472ea63b20781f6a38d0&interface=public®ion_id=RegionOne => generated 195 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:20.955703 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adb5e6-11d9-4a6b-bb8b-10d2937e8e10 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:20.988292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4617d3-ce4f-4efd-9077-dfde3b980d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:20.989635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4617d3-ce4f-4efd-9077-dfde3b980d2c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:20.990486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4617d3-ce4f-4efd-9077-dfde3b980d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:20.991152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4617d3-ce4f-4efd-9077-dfde3b980d2c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:20.992160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4617d3-ce4f-4efd-9077-dfde3b980d2c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:20.994388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4617d3-ce4f-4efd-9077-dfde3b980d2c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2f4617d3-ce4f-4efd-9077-dfde3b980d2c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:21.014974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:21.016167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 16:14:21.017041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:21.020381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 385/779] 10.222.0.112 () {56 vars in 1134 bytes} [Fri Jun 3 16:14:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:21.021563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4617d3-ce4f-4efd-9077-dfde3b980d2c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:21.028762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:21.092018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adb5e6-11d9-4a6b-bb8b-10d2937e8e10 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:21.131233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44175e55-39d6-414f-a13d-543645951214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:21.132969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44175e55-39d6-414f-a13d-543645951214 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.133553 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44175e55-39d6-414f-a13d-543645951214 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.134269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44175e55-39d6-414f-a13d-543645951214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.139532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4617d3-ce4f-4efd-9077-dfde3b980d2c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:21.149282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44175e55-39d6-414f-a13d-543645951214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:21.151148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44175e55-39d6-414f-a13d-543645951214 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-44175e55-39d6-414f-a13d-543645951214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:21.172410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:21.173382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:21.174292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:21.174292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:21.174292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:21.174292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:21.174517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77212d44-841e-4638-898c-aecd27ed9964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:21.175209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77212d44-841e-4638-898c-aecd27ed9964 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.175493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77212d44-841e-4638-898c-aecd27ed9964 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.175825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77212d44-841e-4638-898c-aecd27ed9964 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.176844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77212d44-841e-4638-898c-aecd27ed9964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:21.177924 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77212d44-841e-4638-898c-aecd27ed9964 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:21.178358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 395/780] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:21.179611 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44175e55-39d6-414f-a13d-543645951214 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:21.185262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 386/781] 10.222.0.112 () {56 vars in 1092 bytes} [Fri Jun 3 16:14:21 2022] GET /identity/v3/services => generated 776 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:21.185412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77212d44-841e-4638-898c-aecd27ed9964 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:21.228086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:21.323925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:21.370594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77212d44-841e-4638-898c-aecd27ed9964 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:21.406646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44175e55-39d6-414f-a13d-543645951214 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:21.408543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd0f22-cf93-4cae-8e29-dce4376cbe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:21.409328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd0f22-cf93-4cae-8e29-dce4376cbe90 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.409717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd0f22-cf93-4cae-8e29-dce4376cbe90 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.410097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd0f22-cf93-4cae-8e29-dce4376cbe90 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.410935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd0f22-cf93-4cae-8e29-dce4376cbe90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:21.411358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd0f22-cf93-4cae-8e29-dce4376cbe90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:21.413225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd0f22-cf93-4cae-8e29-dce4376cbe90 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:21.426916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 387/782] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:21.428301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a0a1b-1aa5-40b0-a264-d285e47a129f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.428591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a0a1b-1aa5-40b0-a264-d285e47a129f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.428869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a0a1b-1aa5-40b0-a264-d285e47a129f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.430411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 388/783] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:21.431892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a0a1b-1aa5-40b0-a264-d285e47a129f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:21.452623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cfd21-4761-416b-ad48-ed57fff226ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:21.453547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfd21-4761-416b-ad48-ed57fff226ac None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.453839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfd21-4761-416b-ad48-ed57fff226ac None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.454113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfd21-4761-416b-ad48-ed57fff226ac None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.454973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cfd21-4761-416b-ad48-ed57fff226ac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:21.455711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cfd21-4761-416b-ad48-ed57fff226ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:21.457035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cfd21-4761-416b-ad48-ed57fff226ac None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:21.463607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 396/784] 10.222.0.112 () {56 vars in 1129 bytes} [Fri Jun 3 16:14:21 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:21.464870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e4af-b062-4b47-8870-537235063ff6 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.465223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e4af-b062-4b47-8870-537235063ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.465500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e4af-b062-4b47-8870-537235063ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.486176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6660e4af-b062-4b47-8870-537235063ff6 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:21.487293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6660e4af-b062-4b47-8870-537235063ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:21.551982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a0a1b-1aa5-40b0-a264-d285e47a129f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:21.582911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 397/785] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:21 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:21.582911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660e4af-b062-4b47-8870-537235063ff6 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:21.595733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:21.598306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:21.615917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297871c-85b1-40d6-85d5-2b2ed17a51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:21.617082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297871c-85b1-40d6-85d5-2b2ed17a51b0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.617618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297871c-85b1-40d6-85d5-2b2ed17a51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.618110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297871c-85b1-40d6-85d5-2b2ed17a51b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.626676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297871c-85b1-40d6-85d5-2b2ed17a51b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:21.628434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297871c-85b1-40d6-85d5-2b2ed17a51b0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-0297871c-85b1-40d6-85d5-2b2ed17a51b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:21.646099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:21.647129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:21.648556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:21.650961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 389/786] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:14:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:21.652016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297871c-85b1-40d6-85d5-2b2ed17a51b0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:21.710663 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660e4af-b062-4b47-8870-537235063ff6 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:21.754965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789121-11df-44f5-a0e3-badfb0818b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:21.756115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789121-11df-44f5-a0e3-badfb0818b00 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.756656 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789121-11df-44f5-a0e3-badfb0818b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.757138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db789121-11df-44f5-a0e3-badfb0818b00 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.758059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789121-11df-44f5-a0e3-badfb0818b00 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:21.758585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789121-11df-44f5-a0e3-badfb0818b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:21.760219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db789121-11df-44f5-a0e3-badfb0818b00 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:21.766190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 398/787] 10.222.0.112 () {56 vars in 1129 bytes} [Fri Jun 3 16:14:21 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:21.766900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297871c-85b1-40d6-85d5-2b2ed17a51b0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:21.767654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789121-11df-44f5-a0e3-badfb0818b00 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:21.807941 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45077c0d-f4f3-4b4b-aab8-c556b61edef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:21.808788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077c0d-f4f3-4b4b-aab8-c556b61edef1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.809073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077c0d-f4f3-4b4b-aab8-c556b61edef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.809352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45077c0d-f4f3-4b4b-aab8-c556b61edef1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.822067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45077c0d-f4f3-4b4b-aab8-c556b61edef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-45077c0d-f4f3-4b4b-aab8-c556b61edef1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:21.830453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:21.831512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:21.832425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:21.836843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 390/788] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:21.838175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45077c0d-f4f3-4b4b-aab8-c556b61edef1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:21.862870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:21.886397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db789121-11df-44f5-a0e3-badfb0818b00 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:21.892707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:21.924047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97275255-587b-4090-9171-c1ffb2ce9665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:21.925106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97275255-587b-4090-9171-c1ffb2ce9665 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.925597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97275255-587b-4090-9171-c1ffb2ce9665 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.926081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97275255-587b-4090-9171-c1ffb2ce9665 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.927152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97275255-587b-4090-9171-c1ffb2ce9665 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:21.927694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97275255-587b-4090-9171-c1ffb2ce9665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:21.929462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97275255-587b-4090-9171-c1ffb2ce9665 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:21.948833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 399/789] 10.222.0.112 () {56 vars in 1154 bytes} [Fri Jun 3 16:14:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:21.950040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97275255-587b-4090-9171-c1ffb2ce9665 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:21.953676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45077c0d-f4f3-4b4b-aab8-c556b61edef1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:21.991686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e664f6-9a90-487d-bbdc-105b86206fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:21.992347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e664f6-9a90-487d-bbdc-105b86206fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:21.992632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e664f6-9a90-487d-bbdc-105b86206fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:21.992914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e664f6-9a90-487d-bbdc-105b86206fd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:21.993710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e664f6-9a90-487d-bbdc-105b86206fd8 None admin] RBAC: Adding query filter params (interface=public, service_id=df5ae0bab1fb40a8a50ae6ec292ed7a1, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:21.994151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e664f6-9a90-487d-bbdc-105b86206fd8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:21.995686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e664f6-9a90-487d-bbdc-105b86206fd8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:22.004531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 391/790] 10.222.0.112 () {56 vars in 1256 bytes} [Fri Jun 3 16:14:21 2022] GET /identity/v3/endpoints?service_id=df5ae0bab1fb40a8a50ae6ec292ed7a1&interface=public®ion_id=RegionOne => generated 195 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:22.005433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e664f6-9a90-487d-bbdc-105b86206fd8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.059324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97275255-587b-4090-9171-c1ffb2ce9665 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:22.096163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e3662-bc1f-4633-bf9f-018914e3c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:22.097093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e3662-bc1f-4633-bf9f-018914e3c8ad None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.097531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e3662-bc1f-4633-bf9f-018914e3c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.097980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e3662-bc1f-4633-bf9f-018914e3c8ad None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.098887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e3662-bc1f-4633-bf9f-018914e3c8ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:22.099344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e3662-bc1f-4633-bf9f-018914e3c8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:22.100894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e3662-bc1f-4633-bf9f-018914e3c8ad None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:22.103579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:22.116378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 400/791] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:21 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:22.116378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e3662-bc1f-4633-bf9f-018914e3c8ad None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.128363 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e664f6-9a90-487d-bbdc-105b86206fd8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:22.140923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:22.169245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aecc4-7fe3-4285-a346-4696ea19b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:22.170397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aecc4-7fe3-4285-a346-4696ea19b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.170939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aecc4-7fe3-4285-a346-4696ea19b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.171361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aecc4-7fe3-4285-a346-4696ea19b2f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.186774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aecc4-7fe3-4285-a346-4696ea19b2f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:22.188482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aecc4-7fe3-4285-a346-4696ea19b2f0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-388aecc4-7fe3-4285-a346-4696ea19b2f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:22.207745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:22.208794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:22.209709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:22.209709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:22.209709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:22.209709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:22.209709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 392/792] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:22.210868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aecc4-7fe3-4285-a346-4696ea19b2f0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.229563 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e3662-bc1f-4633-bf9f-018914e3c8ad None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:22.268938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5014e-d6f1-49da-a0f0-8960246a5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:22.269865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5014e-d6f1-49da-a0f0-8960246a5a68 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.270717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5014e-d6f1-49da-a0f0-8960246a5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.271155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5014e-d6f1-49da-a0f0-8960246a5a68 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.272283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5014e-d6f1-49da-a0f0-8960246a5a68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:22.274544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5014e-d6f1-49da-a0f0-8960246a5a68 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:22.291767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 401/793] 10.222.0.112 () {56 vars in 1092 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/services => generated 776 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:22.293623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68da62-330d-4d06-9e18-8536de06c34b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.294135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68da62-330d-4d06-9e18-8536de06c34b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.294599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68da62-330d-4d06-9e18-8536de06c34b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.296281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 402/794] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:22.296876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68da62-330d-4d06-9e18-8536de06c34b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.332001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aecc4-7fe3-4285-a346-4696ea19b2f0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:22.371263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dea765-755b-4c65-8c17-6d67f772e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:22.372213 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dea765-755b-4c65-8c17-6d67f772e2db None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.372495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dea765-755b-4c65-8c17-6d67f772e2db None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.372818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dea765-755b-4c65-8c17-6d67f772e2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.385391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dea765-755b-4c65-8c17-6d67f772e2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:22.386379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:22.387980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dea765-755b-4c65-8c17-6d67f772e2db None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-88dea765-755b-4c65-8c17-6d67f772e2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:22.409481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:22.410479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:22.411405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:22.411405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:22.411405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:22.411405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:22.415648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 393/795] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:22.417176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7649504-a100-46d0-84e7-3fe84a230fb0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.417473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7649504-a100-46d0-84e7-3fe84a230fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.417756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7649504-a100-46d0-84e7-3fe84a230fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.436772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f7649504-a100-46d0-84e7-3fe84a230fb0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:22.438130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f7649504-a100-46d0-84e7-3fe84a230fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:22.444222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68da62-330d-4d06-9e18-8536de06c34b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:22.471977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:22.496273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805936c-1846-42e0-8266-ceefd8bb7df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:22.497897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805936c-1846-42e0-8266-ceefd8bb7df7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.498189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805936c-1846-42e0-8266-ceefd8bb7df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.498471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805936c-1846-42e0-8266-ceefd8bb7df7 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.499224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805936c-1846-42e0-8266-ceefd8bb7df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:22.499620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805936c-1846-42e0-8266-ceefd8bb7df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:22.501048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805936c-1846-42e0-8266-ceefd8bb7df7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:22.516956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 403/796] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:22.519523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805936c-1846-42e0-8266-ceefd8bb7df7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.528858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 394/797] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:22 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:22.529820 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7649504-a100-46d0-84e7-3fe84a230fb0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.644257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805936c-1846-42e0-8266-ceefd8bb7df7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:22.662490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7649504-a100-46d0-84e7-3fe84a230fb0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:22.678950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:22.691799 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23b84-f6d6-4772-a6f3-e8368cd9ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:22.693076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23b84-f6d6-4772-a6f3-e8368cd9ddaa None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.693799 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23b84-f6d6-4772-a6f3-e8368cd9ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.694393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23b84-f6d6-4772-a6f3-e8368cd9ddaa None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.696060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b23b84-f6d6-4772-a6f3-e8368cd9ddaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:22.696561 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b23b84-f6d6-4772-a6f3-e8368cd9ddaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:22.699144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b23b84-f6d6-4772-a6f3-e8368cd9ddaa None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:22.706791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11333945-0c0f-4c8e-80af-69e5b63ef0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:22.707714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11333945-0c0f-4c8e-80af-69e5b63ef0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.708068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11333945-0c0f-4c8e-80af-69e5b63ef0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.708417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11333945-0c0f-4c8e-80af-69e5b63ef0c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.716498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 404/798] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:22.717606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23b84-f6d6-4772-a6f3-e8368cd9ddaa None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.723717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11333945-0c0f-4c8e-80af-69e5b63ef0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:22.725365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11333945-0c0f-4c8e-80af-69e5b63ef0c1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-11333945-0c0f-4c8e-80af-69e5b63ef0c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:22.743425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:22.744457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:22.745417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:22.745417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:22.745417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:22.745417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:22.745417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:22.745417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:22.745417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:22.745417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:22.750629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 395/799] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:22.751605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11333945-0c0f-4c8e-80af-69e5b63ef0c1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.758173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:22.846811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23b84-f6d6-4772-a6f3-e8368cd9ddaa None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:22.883145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11333945-0c0f-4c8e-80af-69e5b63ef0c1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:22.884408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4473b7-5117-40ed-b227-4b8007930c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:22.885744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4473b7-5117-40ed-b227-4b8007930c3f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.886239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4473b7-5117-40ed-b227-4b8007930c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.887259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4473b7-5117-40ed-b227-4b8007930c3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.898783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4473b7-5117-40ed-b227-4b8007930c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-1b4473b7-5117-40ed-b227-4b8007930c3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:22.907470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:22.908665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:22.909730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:22.912437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 405/800] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:22.913886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4473b7-5117-40ed-b227-4b8007930c3f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.923823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b0baa-b5ab-4a7d-9545-c923fa695688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:22.924622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b0baa-b5ab-4a7d-9545-c923fa695688 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:22.924904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b0baa-b5ab-4a7d-9545-c923fa695688 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:22.925181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b0baa-b5ab-4a7d-9545-c923fa695688 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:22.935310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b0baa-b5ab-4a7d-9545-c923fa695688 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:22.937100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b0baa-b5ab-4a7d-9545-c923fa695688 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-743b0baa-b5ab-4a7d-9545-c923fa695688 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:22.955913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:22.956956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:22.957937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:22.959628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 396/801] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:22.960679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b0baa-b5ab-4a7d-9545-c923fa695688 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:22.971969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:23.039467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:23.040712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4473b7-5117-40ed-b227-4b8007930c3f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:23.080878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b0baa-b5ab-4a7d-9545-c923fa695688 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:23.083960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bbf94-fcf6-4227-a12d-507f4537d2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:23.084676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bbf94-fcf6-4227-a12d-507f4537d2bc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.084958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bbf94-fcf6-4227-a12d-507f4537d2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.085233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bbf94-fcf6-4227-a12d-507f4537d2bc None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.086022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bbf94-fcf6-4227-a12d-507f4537d2bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:23.086331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bbf94-fcf6-4227-a12d-507f4537d2bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:23.087924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bbf94-fcf6-4227-a12d-507f4537d2bc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:23.107692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 406/802] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:23.108592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bbf94-fcf6-4227-a12d-507f4537d2bc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:23.123901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820ee50-0b5c-4aa7-9138-02aa71d3feb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:23.124957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820ee50-0b5c-4aa7-9138-02aa71d3feb2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.125531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820ee50-0b5c-4aa7-9138-02aa71d3feb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.126039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820ee50-0b5c-4aa7-9138-02aa71d3feb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.127042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820ee50-0b5c-4aa7-9138-02aa71d3feb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:23.127594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820ee50-0b5c-4aa7-9138-02aa71d3feb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:23.129217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820ee50-0b5c-4aa7-9138-02aa71d3feb2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:23.138903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 397/803] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:23.140365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820ee50-0b5c-4aa7-9138-02aa71d3feb2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:23.241518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bbf94-fcf6-4227-a12d-507f4537d2bc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:23.243266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:23.281284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820ee50-0b5c-4aa7-9138-02aa71d3feb2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:23.281767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c84645-0d0f-45f0-bb3e-6702fbd584ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:23.282789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c84645-0d0f-45f0-bb3e-6702fbd584ba None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.283313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c84645-0d0f-45f0-bb3e-6702fbd584ba None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.283917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c84645-0d0f-45f0-bb3e-6702fbd584ba None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.284932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c84645-0d0f-45f0-bb3e-6702fbd584ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:23.285394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c84645-0d0f-45f0-bb3e-6702fbd584ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:23.287024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c84645-0d0f-45f0-bb3e-6702fbd584ba None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:23.311897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 407/804] 10.222.0.112 () {56 vars in 1140 bytes} [Fri Jun 3 16:14:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:23.313129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:23.314244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c84645-0d0f-45f0-bb3e-6702fbd584ba None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:23.327250 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb57f55-e2b4-4461-8926-0a55bb144479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:23.328627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb57f55-e2b4-4461-8926-0a55bb144479 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.328911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb57f55-e2b4-4461-8926-0a55bb144479 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.329188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb57f55-e2b4-4461-8926-0a55bb144479 None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/9b44182e2e5b4b34bd549452c305c194/roles/32d5f0d8a0564b0286e98637266edf11` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.349973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb57f55-e2b4-4461-8926-0a55bb144479 None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=9b44182e2e5b4b34bd549452c305c194, role_id=32d5f0d8a0564b0286e98637266edf11)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:23.351926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb57f55-e2b4-4461-8926-0a55bb144479 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:23.375688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 398/805] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:14:23 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/9b44182e2e5b4b34bd549452c305c194/roles/32d5f0d8a0564b0286e98637266edf11 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:14:23.377222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb57f55-e2b4-4461-8926-0a55bb144479 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:23.516108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c84645-0d0f-45f0-bb3e-6702fbd584ba None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:23.594695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb57f55-e2b4-4461-8926-0a55bb144479 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:23.612952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa457f9-e5bc-4b0c-8fb6-efa5d8f66342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:23.613762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa457f9-e5bc-4b0c-8fb6-efa5d8f66342 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.614046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa457f9-e5bc-4b0c-8fb6-efa5d8f66342 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.614321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa457f9-e5bc-4b0c-8fb6-efa5d8f66342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.631083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa457f9-e5bc-4b0c-8fb6-efa5d8f66342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:23.632697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa457f9-e5bc-4b0c-8fb6-efa5d8f66342 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:23.639926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a829f1-6fa1-446d-b277-499c2377c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:23.641055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a829f1-6fa1-446d-b277-499c2377c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.641516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a829f1-6fa1-446d-b277-499c2377c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.641943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a829f1-6fa1-446d-b277-499c2377c6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-cfa457f9-e5bc-4b0c-8fb6-efa5d8f66342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:23.655691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:23.656864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:23.657966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:23.657966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:23.657966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:23.657966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:23.657966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 408/806] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:23.658618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a829f1-6fa1-446d-b277-499c2377c6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:23.660333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a829f1-6fa1-446d-b277-499c2377c6d1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:23.663029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa457f9-e5bc-4b0c-8fb6-efa5d8f66342 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-10a829f1-6fa1-446d-b277-499c2377c6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:23.679724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:23.680873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:23.681905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:23.681905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:23.681905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:23.681905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:23.682169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:23.684081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 399/807] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:23.690877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a829f1-6fa1-446d-b277-499c2377c6d1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:23.724686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:23.788119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa457f9-e5bc-4b0c-8fb6-efa5d8f66342 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:23.810912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a829f1-6fa1-446d-b277-499c2377c6d1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:23.827928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e867fb-14df-45cb-87b3-2604785308fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:23.828525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e867fb-14df-45cb-87b3-2604785308fc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.828812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e867fb-14df-45cb-87b3-2604785308fc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.829091 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e867fb-14df-45cb-87b3-2604785308fc None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.829841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e867fb-14df-45cb-87b3-2604785308fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:23.830158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e867fb-14df-45cb-87b3-2604785308fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:23.831631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e867fb-14df-45cb-87b3-2604785308fc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:23.845402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 409/808] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:23.846794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8d47c-ed15-4b61-bbc0-29f0c40cf9be None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.847090 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8d47c-ed15-4b61-bbc0-29f0c40cf9be None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.847371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8d47c-ed15-4b61-bbc0-29f0c40cf9be None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.852175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fc0ec-7b7c-46cb-b200-d40944a409ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:23.853066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fc0ec-7b7c-46cb-b200-d40944a409ef None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.853477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 410/809] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:23 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:23.853680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fc0ec-7b7c-46cb-b200-d40944a409ef None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.854097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fc0ec-7b7c-46cb-b200-d40944a409ef None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.854322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8d47c-ed15-4b61-bbc0-29f0c40cf9be None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:23.855149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fc0ec-7b7c-46cb-b200-d40944a409ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:23.855688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fc0ec-7b7c-46cb-b200-d40944a409ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:23.857635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fc0ec-7b7c-46cb-b200-d40944a409ef None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:23.870762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 400/810] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:23.876916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291144e-e14d-476a-9300-8f5244c06b98 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:23.877440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291144e-e14d-476a-9300-8f5244c06b98 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:23.877935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291144e-e14d-476a-9300-8f5244c06b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:23.897113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2291144e-e14d-476a-9300-8f5244c06b98 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:23.898659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2291144e-e14d-476a-9300-8f5244c06b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:23.946266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:23.972114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 401/811] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:23 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:23.973260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291144e-e14d-476a-9300-8f5244c06b98 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:23.980117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8d47c-ed15-4b61-bbc0-29f0c40cf9be None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:23.992678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:24.026443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457c015-37ac-4426-b02d-201682d988d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:24.027696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457c015-37ac-4426-b02d-201682d988d5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:24.028060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457c015-37ac-4426-b02d-201682d988d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:24.028417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457c015-37ac-4426-b02d-201682d988d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:24.039058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457c015-37ac-4426-b02d-201682d988d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:24.041285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457c015-37ac-4426-b02d-201682d988d5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3457c015-37ac-4426-b02d-201682d988d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:24.060650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:24.061890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:24.063094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:24.064136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 411/812] 10.222.0.112 () {56 vars in 1098 bytes} [Fri Jun 3 16:14:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:24.068121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457c015-37ac-4426-b02d-201682d988d5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:24.092925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291144e-e14d-476a-9300-8f5244c06b98 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:24.130025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54490122-0994-458d-925c-09601b8f840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:24.131066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54490122-0994-458d-925c-09601b8f840c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:24.131653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54490122-0994-458d-925c-09601b8f840c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:24.132138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54490122-0994-458d-925c-09601b8f840c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:24.140272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54490122-0994-458d-925c-09601b8f840c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:24.142022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54490122-0994-458d-925c-09601b8f840c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-54490122-0994-458d-925c-09601b8f840c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:24.157856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:24.158811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:24.159768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:24.159768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:24.159768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:24.159768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:24.159768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:24.159768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:24.159768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:24.159768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:24.166837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 402/813] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:24.168184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54490122-0994-458d-925c-09601b8f840c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:24.201731 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457c015-37ac-4426-b02d-201682d988d5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:24.243161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:24.254140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356f010-4090-45d4-b2ad-e5f3db2c573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:24.255704 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356f010-4090-45d4-b2ad-e5f3db2c573f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:24.256222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356f010-4090-45d4-b2ad-e5f3db2c573f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:24.256650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356f010-4090-45d4-b2ad-e5f3db2c573f None admin] PATH_INFO: `/v3/services/network` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:24.257934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356f010-4090-45d4-b2ad-e5f3db2c573f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:24.260073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:24.260326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356f010-4090-45d4-b2ad-e5f3db2c573f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-2356f010-4090-45d4-b2ad-e5f3db2c573f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:24.277342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:24.278412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:24.279280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 412/814] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:24 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:24.280635 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356f010-4090-45d4-b2ad-e5f3db2c573f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:24.287146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54490122-0994-458d-925c-09601b8f840c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:24.325209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb585e9-6909-468e-afaf-26abd0890abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:24.326237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb585e9-6909-468e-afaf-26abd0890abd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:24.326724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb585e9-6909-468e-afaf-26abd0890abd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:24.327276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb585e9-6909-468e-afaf-26abd0890abd None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:24.328411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb585e9-6909-468e-afaf-26abd0890abd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:24.328932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb585e9-6909-468e-afaf-26abd0890abd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:24.330604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb585e9-6909-468e-afaf-26abd0890abd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:24.350829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 403/815] 10.222.0.112 () {56 vars in 1138 bytes} [Fri Jun 3 16:14:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:24.352551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb585e9-6909-468e-afaf-26abd0890abd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:24.411377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356f010-4090-45d4-b2ad-e5f3db2c573f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:24.449320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae34e26-d11c-4747-9d2f-c643008c3e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:24.449998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae34e26-d11c-4747-9d2f-c643008c3e84 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:24.450284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae34e26-d11c-4747-9d2f-c643008c3e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:24.450566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae34e26-d11c-4747-9d2f-c643008c3e84 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:24.451392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae34e26-d11c-4747-9d2f-c643008c3e84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:24.451707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae34e26-d11c-4747-9d2f-c643008c3e84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:24.453158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae34e26-d11c-4747-9d2f-c643008c3e84 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:24.471067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 413/816] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:24.471067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae34e26-d11c-4747-9d2f-c643008c3e84 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:24.478193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb585e9-6909-468e-afaf-26abd0890abd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:24.526852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce60061-4b65-4f64-936c-998f47902180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:24.527983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce60061-4b65-4f64-936c-998f47902180 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:24.528435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce60061-4b65-4f64-936c-998f47902180 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:24.528873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce60061-4b65-4f64-936c-998f47902180 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:24.529741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce60061-4b65-4f64-936c-998f47902180 None admin] RBAC: Adding query filter params (name=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:24.530275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce60061-4b65-4f64-936c-998f47902180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:24.531364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:24.532350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce60061-4b65-4f64-936c-998f47902180 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:24.534902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:24.540259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 404/817] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:24 2022] GET /identity/v3/services?name=network => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:24.541389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce60061-4b65-4f64-936c-998f47902180 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:24.581168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae34e26-d11c-4747-9d2f-c643008c3e84 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:24.623870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5232-f3a8-4658-89f0-d852a65e6e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:24.624524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5232-f3a8-4658-89f0-d852a65e6e75 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:24.624818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5232-f3a8-4658-89f0-d852a65e6e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:24.625102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5232-f3a8-4658-89f0-d852a65e6e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:24.658487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce60061-4b65-4f64-936c-998f47902180 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:24.697560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841780e-e8fb-4913-a304-a28721533f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:24.698784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841780e-e8fb-4913-a304-a28721533f84 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:24.699316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841780e-e8fb-4913-a304-a28721533f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:24.699818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841780e-e8fb-4913-a304-a28721533f84 None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/f8e7179f5fe945f4be1ca16263042b3f/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:24.700727 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde5232-f3a8-4658-89f0-d852a65e6e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:24.702346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841780e-e8fb-4913-a304-a28721533f84 None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=f8e7179f5fe945f4be1ca16263042b3f, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:24.702497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde5232-f3a8-4658-89f0-d852a65e6e75 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:24.704198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841780e-e8fb-4913-a304-a28721533f84 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:24.727734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 405/818] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:14:24 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/f8e7179f5fe945f4be1ca16263042b3f/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:14:24.729060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841780e-e8fb-4913-a304-a28721533f84 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:24.800726 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:24.844413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:24.889626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 414/819] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:24 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:14:24.897940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5232-f3a8-4658-89f0-d852a65e6e75 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:24.950477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841780e-e8fb-4913-a304-a28721533f84 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:25.010930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8db42a-cfc5-4c08-ad75-e44e36fb346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:25.011792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8db42a-cfc5-4c08-ad75-e44e36fb346c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.012113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8db42a-cfc5-4c08-ad75-e44e36fb346c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.012545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8db42a-cfc5-4c08-ad75-e44e36fb346c None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.013362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8db42a-cfc5-4c08-ad75-e44e36fb346c None admin] RBAC: Adding query filter params (type=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:25.013759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8db42a-cfc5-4c08-ad75-e44e36fb346c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:25.015897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8db42a-cfc5-4c08-ad75-e44e36fb346c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:25.024694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 406/820] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:24 2022] GET /identity/v3/services?type=network => generated 352 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:25.026574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81673-7af3-4167-b8af-cff1657903fd None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.028013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81673-7af3-4167-b8af-cff1657903fd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.028013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c81673-7af3-4167-b8af-cff1657903fd None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.032228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5232-f3a8-4658-89f0-d852a65e6e75 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:25.032493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 407/821] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:25.036356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a8817-865e-42dc-85f4-3e6e4682935f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.036639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a8817-865e-42dc-85f4-3e6e4682935f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.036918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a8817-865e-42dc-85f4-3e6e4682935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.061165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5f5a8817-865e-42dc-85f4-3e6e4682935f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:25.063504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5f5a8817-865e-42dc-85f4-3e6e4682935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:25.082933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f14021-c632-433c-8d46-71c4fdcb014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:25.084295 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f14021-c632-433c-8d46-71c4fdcb014a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.084598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f14021-c632-433c-8d46-71c4fdcb014a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.085109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f14021-c632-433c-8d46-71c4fdcb014a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.099205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f14021-c632-433c-8d46-71c4fdcb014a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:25.101352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f14021-c632-433c-8d46-71c4fdcb014a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-42f14021-c632-433c-8d46-71c4fdcb014a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:25.127464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:25.128537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:25.129525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:25.129525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:25.129525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:25.129525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:25.129777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 415/822] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:25.130531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f14021-c632-433c-8d46-71c4fdcb014a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:25.144871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:25.152914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 408/823] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:25 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:25.159601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a8817-865e-42dc-85f4-3e6e4682935f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:25.236264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:25.281075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f14021-c632-433c-8d46-71c4fdcb014a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:25.288868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a8817-865e-42dc-85f4-3e6e4682935f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:25.326541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee41e3-a322-4937-8bbb-3a6ad6821059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:25.327208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee41e3-a322-4937-8bbb-3a6ad6821059 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.327490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee41e3-a322-4937-8bbb-3a6ad6821059 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.327797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee41e3-a322-4937-8bbb-3a6ad6821059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.328819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee41e3-a322-4937-8bbb-3a6ad6821059 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:25.331040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee41e3-a322-4937-8bbb-3a6ad6821059 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:25.334778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76b4d-3390-49f3-bb9e-2e5d09ba742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:25.335979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76b4d-3390-49f3-bb9e-2e5d09ba742c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.336790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76b4d-3390-49f3-bb9e-2e5d09ba742c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.337413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76b4d-3390-49f3-bb9e-2e5d09ba742c None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.338562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76b4d-3390-49f3-bb9e-2e5d09ba742c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:25.339077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76b4d-3390-49f3-bb9e-2e5d09ba742c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:25.340930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76b4d-3390-49f3-bb9e-2e5d09ba742c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:25.359473 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 416/824] 10.222.0.112 () {60 vars in 1149 bytes} [Fri Jun 3 16:14:25 2022] POST /identity/v3/endpoints => generated 329 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:25.360856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee41e3-a322-4937-8bbb-3a6ad6821059 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:25.368978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 409/825] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:25.377906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76b4d-3390-49f3-bb9e-2e5d09ba742c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:25.493014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:25.538119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76b4d-3390-49f3-bb9e-2e5d09ba742c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:25.576005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:25.592342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beacab3-e2fe-452e-8c3e-9383475a56fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:25.593470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beacab3-e2fe-452e-8c3e-9383475a56fd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.593932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beacab3-e2fe-452e-8c3e-9383475a56fd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.594371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beacab3-e2fe-452e-8c3e-9383475a56fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.597225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee41e3-a322-4937-8bbb-3a6ad6821059 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:25.613912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beacab3-e2fe-452e-8c3e-9383475a56fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:25.615914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beacab3-e2fe-452e-8c3e-9383475a56fd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-6beacab3-e2fe-452e-8c3e-9383475a56fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:25.642506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:25.643754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:25.644912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:25.644912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:25.644912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:25.644912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:25.644912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:25.644912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:25.644912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:25.644912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:25.644912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 410/826] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:25.650347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beacab3-e2fe-452e-8c3e-9383475a56fd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:25.653847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298ab6f-ee3c-4962-a349-fbd58a9f4d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:25.655195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ab6f-ee3c-4962-a349-fbd58a9f4d95 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.656617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ab6f-ee3c-4962-a349-fbd58a9f4d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.657107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298ab6f-ee3c-4962-a349-fbd58a9f4d95 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.658000 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298ab6f-ee3c-4962-a349-fbd58a9f4d95 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:25.659700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298ab6f-ee3c-4962-a349-fbd58a9f4d95 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-1298ab6f-ee3c-4962-a349-fbd58a9f4d95 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:25.678835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:25.680152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 16:14:25.681204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:25.684038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 417/827] 10.222.0.112 () {56 vars in 1134 bytes} [Fri Jun 3 16:14:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:25.689694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298ab6f-ee3c-4962-a349-fbd58a9f4d95 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:25.788051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beacab3-e2fe-452e-8c3e-9383475a56fd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:25.824248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298ab6f-ee3c-4962-a349-fbd58a9f4d95 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:25.833773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ff512-8ccc-4e31-9558-48c8ec1e763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:25.834463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff512-8ccc-4e31-9558-48c8ec1e763a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.834794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff512-8ccc-4e31-9558-48c8ec1e763a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.835092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ff512-8ccc-4e31-9558-48c8ec1e763a None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.838076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ff512-8ccc-4e31-9558-48c8ec1e763a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:25.838433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ff512-8ccc-4e31-9558-48c8ec1e763a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:25.840579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ff512-8ccc-4e31-9558-48c8ec1e763a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:25.857760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 411/828] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:25.861648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:25.864338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ff512-8ccc-4e31-9558-48c8ec1e763a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:25.876478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d942fd-a5da-44a0-a4fe-ad27b67571ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:25.877614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d942fd-a5da-44a0-a4fe-ad27b67571ad None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:25.878183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d942fd-a5da-44a0-a4fe-ad27b67571ad None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:25.878766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d942fd-a5da-44a0-a4fe-ad27b67571ad None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:25.879823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d942fd-a5da-44a0-a4fe-ad27b67571ad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:25.880536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d942fd-a5da-44a0-a4fe-ad27b67571ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:25.882317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d942fd-a5da-44a0-a4fe-ad27b67571ad None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:25.889281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 418/829] 10.222.0.112 () {56 vars in 1129 bytes} [Fri Jun 3 16:14:25 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:25.897120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d942fd-a5da-44a0-a4fe-ad27b67571ad None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:25.901581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:25.983707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ff512-8ccc-4e31-9558-48c8ec1e763a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:26.007839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d942fd-a5da-44a0-a4fe-ad27b67571ad None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:26.021654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fea3a-ab4d-46a4-9115-ead14dd65dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:26.022501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fea3a-ab4d-46a4-9115-ead14dd65dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:26.022888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fea3a-ab4d-46a4-9115-ead14dd65dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:26.023226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fea3a-ab4d-46a4-9115-ead14dd65dd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:26.024111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fea3a-ab4d-46a4-9115-ead14dd65dd0 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=3a650b8d49ad480bb1620209a8b7c6e9) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:26.024429 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fea3a-ab4d-46a4-9115-ead14dd65dd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:26.025887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fea3a-ab4d-46a4-9115-ead14dd65dd0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:26.033532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 412/830] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:25 2022] GET /identity/v3/role_assignments?user.id=3a650b8d49ad480bb1620209a8b7c6e9&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 610 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:26.035128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252252b-1292-479d-aa8c-7b4ed06951ca None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:26.035422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252252b-1292-479d-aa8c-7b4ed06951ca None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:26.035668 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252252b-1292-479d-aa8c-7b4ed06951ca None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:26.037188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 413/831] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:26.044045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119941d-d416-4377-982b-cd13c0dd3c4e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:26.045011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119941d-d416-4377-982b-cd13c0dd3c4e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:26.046064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119941d-d416-4377-982b-cd13c0dd3c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:26.064012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962591a-b94a-4289-97aa-81716bb4b2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:26.065077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962591a-b94a-4289-97aa-81716bb4b2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:26.065567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962591a-b94a-4289-97aa-81716bb4b2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:26.066185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962591a-b94a-4289-97aa-81716bb4b2a0 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:26.067138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962591a-b94a-4289-97aa-81716bb4b2a0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:26.067666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962591a-b94a-4289-97aa-81716bb4b2a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:26.067789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8119941d-d416-4377-982b-cd13c0dd3c4e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:26.069088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8119941d-d416-4377-982b-cd13c0dd3c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:26.069631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962591a-b94a-4289-97aa-81716bb4b2a0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:26.082661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 419/832] 10.222.0.112 () {56 vars in 1129 bytes} [Fri Jun 3 16:14:25 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:26.083276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962591a-b94a-4289-97aa-81716bb4b2a0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:26.148979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:26.183613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 414/833] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:26 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:26.203896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119941d-d416-4377-982b-cd13c0dd3c4e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:26.219761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962591a-b94a-4289-97aa-81716bb4b2a0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:26.244017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:26.274695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65027fb-c708-423b-8f38-e93c6f3e73dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:26.275389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65027fb-c708-423b-8f38-e93c6f3e73dc None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:26.276780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65027fb-c708-423b-8f38-e93c6f3e73dc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:26.276780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65027fb-c708-423b-8f38-e93c6f3e73dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:26.276977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65027fb-c708-423b-8f38-e93c6f3e73dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:26.279502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65027fb-c708-423b-8f38-e93c6f3e73dc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:26.301260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 420/834] 10.222.0.112 () {60 vars in 1149 bytes} [Fri Jun 3 16:14:26 2022] POST /identity/v3/endpoints => generated 348 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:26.342603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119941d-d416-4377-982b-cd13c0dd3c4e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:26.394141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28767f7-2e3c-4130-b494-ba3e55c80df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:26.395130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28767f7-2e3c-4130-b494-ba3e55c80df4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:26.395517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28767f7-2e3c-4130-b494-ba3e55c80df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:26.396019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28767f7-2e3c-4130-b494-ba3e55c80df4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:26.408730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28767f7-2e3c-4130-b494-ba3e55c80df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a28767f7-2e3c-4130-b494-ba3e55c80df4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:26.417067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:26.418327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:14:26.419402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:26.421568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 415/835] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:14:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:26.427251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65027fb-c708-423b-8f38-e93c6f3e73dc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:26.545260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65027fb-c708-423b-8f38-e93c6f3e73dc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:26.560025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:26.584250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fbdc1-3906-44bc-b258-407642d7d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:26.584935 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fbdc1-3906-44bc-b258-407642d7d326 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:26.585217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fbdc1-3906-44bc-b258-407642d7d326 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:26.585495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fbdc1-3906-44bc-b258-407642d7d326 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:26.586250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fbdc1-3906-44bc-b258-407642d7d326 None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:26.586557 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fbdc1-3906-44bc-b258-407642d7d326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:26.587970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fbdc1-3906-44bc-b258-407642d7d326 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:26.596971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 421/836] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:14:26 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:26.602500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28767f7-2e3c-4130-b494-ba3e55c80df4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:26.695204 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:26.718934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28767f7-2e3c-4130-b494-ba3e55c80df4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:26.755581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db193a-9163-444c-9c12-18ea205bc556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:26.756387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db193a-9163-444c-9c12-18ea205bc556 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:26.756667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db193a-9163-444c-9c12-18ea205bc556 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:26.756937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db193a-9163-444c-9c12-18ea205bc556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:26.768419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db193a-9163-444c-9c12-18ea205bc556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:26.769905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db193a-9163-444c-9c12-18ea205bc556 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-00db193a-9163-444c-9c12-18ea205bc556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:26.787469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:26.788624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:26.789739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:26.789739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:26.789739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:26.789739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:26.789739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 416/837] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:26.796345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fbdc1-3906-44bc-b258-407642d7d326 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:26.912025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fbdc1-3906-44bc-b258-407642d7d326 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:26.950890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106a9bc-3375-4de7-9e48-af5716963f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:26.951733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106a9bc-3375-4de7-9e48-af5716963f0c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:26.952115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106a9bc-3375-4de7-9e48-af5716963f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:26.952509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106a9bc-3375-4de7-9e48-af5716963f0c None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:26.953336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106a9bc-3375-4de7-9e48-af5716963f0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:26.953741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106a9bc-3375-4de7-9e48-af5716963f0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:26.955199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106a9bc-3375-4de7-9e48-af5716963f0c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:26.968123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 422/838] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:26.976653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db193a-9163-444c-9c12-18ea205bc556 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:27.084038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db193a-9163-444c-9c12-18ea205bc556 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:27.115824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:27.122980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cd145-2f3a-46bf-857e-86a56f5ae3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:27.123855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cd145-2f3a-46bf-857e-86a56f5ae3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:27.124141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cd145-2f3a-46bf-857e-86a56f5ae3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:27.124417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cd145-2f3a-46bf-857e-86a56f5ae3c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:27.132444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cd145-2f3a-46bf-857e-86a56f5ae3c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:27.133893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cd145-2f3a-46bf-857e-86a56f5ae3c3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1a2cd145-2f3a-46bf-857e-86a56f5ae3c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:27.149262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:27.150270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:27.151257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 417/839] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:14:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:27.158059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106a9bc-3375-4de7-9e48-af5716963f0c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:27.200865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:27.224949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450c63d-78c0-42c7-9685-1976538c0457 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:27.225266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450c63d-78c0-42c7-9685-1976538c0457 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:27.225512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450c63d-78c0-42c7-9685-1976538c0457 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:27.227947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 418/840] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:27.236653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3946e3-d230-4ae6-889d-34d5a16d23de None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:27.237579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3946e3-d230-4ae6-889d-34d5a16d23de None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:27.238795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3946e3-d230-4ae6-889d-34d5a16d23de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:27.264383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cc3946e3-d230-4ae6-889d-34d5a16d23de None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:27.265593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cc3946e3-d230-4ae6-889d-34d5a16d23de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:27.284033 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106a9bc-3375-4de7-9e48-af5716963f0c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:27.321701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9fe24-a536-4d92-ac63-2e9c115a9c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:27.322466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9fe24-a536-4d92-ac63-2e9c115a9c4a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:27.322708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9fe24-a536-4d92-ac63-2e9c115a9c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:27.322982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9fe24-a536-4d92-ac63-2e9c115a9c4a None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:27.323915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9fe24-a536-4d92-ac63-2e9c115a9c4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:27.324808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9fe24-a536-4d92-ac63-2e9c115a9c4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:27.326218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9fe24-a536-4d92-ac63-2e9c115a9c4a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:27.345831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 423/841] 10.222.0.112 () {56 vars in 1154 bytes} [Fri Jun 3 16:14:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:27.351467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 419/842] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:27 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:27.354829 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9fe24-a536-4d92-ac63-2e9c115a9c4a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:27.376412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3946e3-d230-4ae6-889d-34d5a16d23de None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:27.476022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:27.489881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9fe24-a536-4d92-ac63-2e9c115a9c4a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:27.512937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3946e3-d230-4ae6-889d-34d5a16d23de None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:27.531119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edcfbe-eb37-43f6-a511-8cd31883336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:27.531781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edcfbe-eb37-43f6-a511-8cd31883336f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:27.532060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edcfbe-eb37-43f6-a511-8cd31883336f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:27.532380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edcfbe-eb37-43f6-a511-8cd31883336f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:27.548776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:27.566499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39b1f7-dca0-42d8-a80e-a70c766d660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:27.568343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39b1f7-dca0-42d8-a80e-a70c766d660a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:27.569105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39b1f7-dca0-42d8-a80e-a70c766d660a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:27.569608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39b1f7-dca0-42d8-a80e-a70c766d660a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:27.585131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39b1f7-dca0-42d8-a80e-a70c766d660a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4e39b1f7-dca0-42d8-a80e-a70c766d660a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:27.597040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:27.598059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:27.598943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 420/843] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:27.606859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39b1f7-dca0-42d8-a80e-a70c766d660a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:27.620430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edcfbe-eb37-43f6-a511-8cd31883336f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:27.622673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edcfbe-eb37-43f6-a511-8cd31883336f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:27.712797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39b1f7-dca0-42d8-a80e-a70c766d660a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:27.742387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:27.754386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151f302-cdf5-487d-9d3a-b4d985195548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:27.755132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f302-cdf5-487d-9d3a-b4d985195548 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:27.755479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f302-cdf5-487d-9d3a-b4d985195548 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:27.755851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f302-cdf5-487d-9d3a-b4d985195548 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:27.756722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151f302-cdf5-487d-9d3a-b4d985195548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:27.757099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151f302-cdf5-487d-9d3a-b4d985195548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:27.762534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151f302-cdf5-487d-9d3a-b4d985195548 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:27.762890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 424/844] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:27 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:14:27.764417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edcfbe-eb37-43f6-a511-8cd31883336f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:27.775644 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 421/845] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:27.776673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151f302-cdf5-487d-9d3a-b4d985195548 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:27.826011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:27.884296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151f302-cdf5-487d-9d3a-b4d985195548 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:27.891223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edcfbe-eb37-43f6-a511-8cd31883336f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:27.927901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3d70d-dd61-4e70-a640-86881baf1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:27.928992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3d70d-dd61-4e70-a640-86881baf1854 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:27.929230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284e49-74d0-4d28-af79-919ae1a141fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:27.929479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3d70d-dd61-4e70-a640-86881baf1854 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:27.929848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3d70d-dd61-4e70-a640-86881baf1854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:27.930736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284e49-74d0-4d28-af79-919ae1a141fe None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:27.931172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284e49-74d0-4d28-af79-919ae1a141fe None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:27.931617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284e49-74d0-4d28-af79-919ae1a141fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:27.942842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3d70d-dd61-4e70-a640-86881baf1854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:27.944557 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3d70d-dd61-4e70-a640-86881baf1854 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:27.946395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3284e49-74d0-4d28-af79-919ae1a141fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:27.948663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3284e49-74d0-4d28-af79-919ae1a141fe None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-edb3d70d-dd61-4e70-a640-86881baf1854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:27.964260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:27.965483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:27.966633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:27.966633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:27.966633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:27.966633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:27.972511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 425/846] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:27.973765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3d70d-dd61-4e70-a640-86881baf1854 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f3284e49-74d0-4d28-af79-919ae1a141fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:27.976053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:27.977016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:27.978007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:27.978007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:27.978007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:27.978007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:27.980149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 422/847] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:27.986259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284e49-74d0-4d28-af79-919ae1a141fe None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:28.025587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:28.086548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:28.090470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3d70d-dd61-4e70-a640-86881baf1854 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:28.094173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284e49-74d0-4d28-af79-919ae1a141fe None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:28.129619 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e966642-8b27-43e4-8394-e0cc16d43e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:28.130266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e966642-8b27-43e4-8394-e0cc16d43e24 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.130550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e966642-8b27-43e4-8394-e0cc16d43e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.130816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e966642-8b27-43e4-8394-e0cc16d43e24 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.131534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e966642-8b27-43e4-8394-e0cc16d43e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:28.131865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e966642-8b27-43e4-8394-e0cc16d43e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:28.132588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6c75-6228-4a3c-b08c-80e82b35f4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:28.133234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e966642-8b27-43e4-8394-e0cc16d43e24 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:28.133708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6c75-6228-4a3c-b08c-80e82b35f4fd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.134190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6c75-6228-4a3c-b08c-80e82b35f4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.134680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde6c75-6228-4a3c-b08c-80e82b35f4fd None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.135643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde6c75-6228-4a3c-b08c-80e82b35f4fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:28.136157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde6c75-6228-4a3c-b08c-80e82b35f4fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:28.137781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde6c75-6228-4a3c-b08c-80e82b35f4fd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:28.150422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 426/848] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:28.153004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e966642-8b27-43e4-8394-e0cc16d43e24 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:28.154660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 423/849] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:28.163220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6c75-6228-4a3c-b08c-80e82b35f4fd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:28.283008 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e966642-8b27-43e4-8394-e0cc16d43e24 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:28.285694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:28.294295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde6c75-6228-4a3c-b08c-80e82b35f4fd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:28.322342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374f0d7-8de4-4c30-b81e-3f292be99ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:28.323805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374f0d7-8de4-4c30-b81e-3f292be99ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.324290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374f0d7-8de4-4c30-b81e-3f292be99ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.324723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374f0d7-8de4-4c30-b81e-3f292be99ce2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.332173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bcb10-9e1d-4cd6-960e-14fd5ed4c7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:28.333140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bcb10-9e1d-4cd6-960e-14fd5ed4c7ae None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.333522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bcb10-9e1d-4cd6-960e-14fd5ed4c7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.333893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bcb10-9e1d-4cd6-960e-14fd5ed4c7ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.334652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374f0d7-8de4-4c30-b81e-3f292be99ce2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:28.336465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374f0d7-8de4-4c30-b81e-3f292be99ce2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:28.343224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bcb10-9e1d-4cd6-960e-14fd5ed4c7ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:28.344867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bcb10-9e1d-4cd6-960e-14fd5ed4c7ae None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3374f0d7-8de4-4c30-b81e-3f292be99ce2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:28.353369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:28.354449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:28.355970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:28.355970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:28.355970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:28.355970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:28.355970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:28.355970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:28.355970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:28.355970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-837bcb10-9e1d-4cd6-960e-14fd5ed4c7ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:28.363343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:28.364409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:28.365382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 424/851] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:28.366491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bcb10-9e1d-4cd6-960e-14fd5ed4c7ae None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:28.366645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 427/851] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:28.379372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374f0d7-8de4-4c30-b81e-3f292be99ce2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:28.397130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:28.510636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374f0d7-8de4-4c30-b81e-3f292be99ce2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:28.522947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bcb10-9e1d-4cd6-960e-14fd5ed4c7ae None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:28.549281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878bd10-e4b3-43db-a5cf-510d53dee7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:28.550295 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878bd10-e4b3-43db-a5cf-510d53dee7de None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.550775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878bd10-e4b3-43db-a5cf-510d53dee7de None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.551277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878bd10-e4b3-43db-a5cf-510d53dee7de None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.552369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878bd10-e4b3-43db-a5cf-510d53dee7de None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:28.552878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878bd10-e4b3-43db-a5cf-510d53dee7de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:28.554506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878bd10-e4b3-43db-a5cf-510d53dee7de None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:28.569330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fb3d2-4b50-41b8-b8cc-474b6cdfe469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:28.569999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fb3d2-4b50-41b8-b8cc-474b6cdfe469 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.570285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fb3d2-4b50-41b8-b8cc-474b6cdfe469 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.570644 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fb3d2-4b50-41b8-b8cc-474b6cdfe469 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.571447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fb3d2-4b50-41b8-b8cc-474b6cdfe469 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:28.572460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fb3d2-4b50-41b8-b8cc-474b6cdfe469 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:28.573970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fb3d2-4b50-41b8-b8cc-474b6cdfe469 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:28.576174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 428/852] 10.222.0.112 () {56 vars in 1140 bytes} [Fri Jun 3 16:14:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:28.577393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ba87a-c222-4192-bc78-a2504c72a143 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.579592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ba87a-c222-4192-bc78-a2504c72a143 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.579592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ba87a-c222-4192-bc78-a2504c72a143 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.579592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 429/853] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:28.581840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ba87a-c222-4192-bc78-a2504c72a143 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:28.587760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 425/854] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:28.589084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd184080-b26f-472e-9a20-77a4a51d6c36 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.589373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd184080-b26f-472e-9a20-77a4a51d6c36 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.589693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd184080-b26f-472e-9a20-77a4a51d6c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.609048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dd184080-b26f-472e-9a20-77a4a51d6c36 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:28.609250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:28.610281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dd184080-b26f-472e-9a20-77a4a51d6c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:28.682028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 426/855] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:28 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:28.683128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd184080-b26f-472e-9a20-77a4a51d6c36 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:28.692182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:28.696465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ba87a-c222-4192-bc78-a2504c72a143 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:28.732865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefc577-9219-47e1-a6e7-563e66a2b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:28.733512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc577-9219-47e1-a6e7-563e66a2b26a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.733795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc577-9219-47e1-a6e7-563e66a2b26a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.734071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefc577-9219-47e1-a6e7-563e66a2b26a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.790393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd184080-b26f-472e-9a20-77a4a51d6c36 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:28.801929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc577-9219-47e1-a6e7-563e66a2b26a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:28.803326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefc577-9219-47e1-a6e7-563e66a2b26a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:28.824051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09908afe-47bd-4f3f-8f00-15b3c0475d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:28.824703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09908afe-47bd-4f3f-8f00-15b3c0475d51 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.824988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09908afe-47bd-4f3f-8f00-15b3c0475d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.825264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09908afe-47bd-4f3f-8f00-15b3c0475d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.826622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09908afe-47bd-4f3f-8f00-15b3c0475d51 None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=9b44182e2e5b4b34bd549452c305c194) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:28.826932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09908afe-47bd-4f3f-8f00-15b3c0475d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:28.828053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:28.828401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09908afe-47bd-4f3f-8f00-15b3c0475d51 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:28.835173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 427/856] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:28 2022] GET /identity/v3/role_assignments?user.id=9b44182e2e5b4b34bd549452c305c194&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 610 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:28.836277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46c929-1fa3-4570-8af3-13efca76d5d6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.836562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46c929-1fa3-4570-8af3-13efca76d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.836880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46c929-1fa3-4570-8af3-13efca76d5d6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.842328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 428/857] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:28.842328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46c929-1fa3-4570-8af3-13efca76d5d6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:28.921358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 430/858] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:28 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:14:28.922856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b2631-6133-49db-8364-89486ee3ca8b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:28.923225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b2631-6133-49db-8364-89486ee3ca8b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:28.923606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b2631-6133-49db-8364-89486ee3ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:28.926931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:28.942392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dc4b2631-6133-49db-8364-89486ee3ca8b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:28.943678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dc4b2631-6133-49db-8364-89486ee3ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:28.973092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46c929-1fa3-4570-8af3-13efca76d5d6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.015771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0c22c-96b9-4416-b718-bf33df76654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.016609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0c22c-96b9-4416-b718-bf33df76654c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.016889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0c22c-96b9-4416-b718-bf33df76654c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.017161 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0c22c-96b9-4416-b718-bf33df76654c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.017968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0c22c-96b9-4416-b718-bf33df76654c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.019514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0c22c-96b9-4416-b718-bf33df76654c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.035501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 431/859] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:28 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:29.035501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b2631-6133-49db-8364-89486ee3ca8b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-03e0c22c-96b9-4416-b718-bf33df76654c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:29.035823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:29.037160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:29.038056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 429/860] 10.222.0.112 () {56 vars in 1137 bytes} [Fri Jun 3 16:14:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:29.041298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0c22c-96b9-4416-b718-bf33df76654c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:29.103893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:29.163918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0c22c-96b9-4416-b718-bf33df76654c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.167045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b2631-6133-49db-8364-89486ee3ca8b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.203103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723f6ea-41bb-4630-83a1-da2f6360c983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.203930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723f6ea-41bb-4630-83a1-da2f6360c983 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.204040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7504286-45c5-4a02-8614-03d8c819e957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.204267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723f6ea-41bb-4630-83a1-da2f6360c983 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.204622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723f6ea-41bb-4630-83a1-da2f6360c983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.204726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7504286-45c5-4a02-8614-03d8c819e957 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.204916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7504286-45c5-4a02-8614-03d8c819e957 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.205191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7504286-45c5-4a02-8614-03d8c819e957 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.205903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7504286-45c5-4a02-8614-03d8c819e957 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:29.206299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7504286-45c5-4a02-8614-03d8c819e957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.208061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7504286-45c5-4a02-8614-03d8c819e957 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.209368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:29.220379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723f6ea-41bb-4630-83a1-da2f6360c983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.220609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 430/861] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:29.220609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7504286-45c5-4a02-8614-03d8c819e957 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:29.220788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723f6ea-41bb-4630-83a1-da2f6360c983 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-6723f6ea-41bb-4630-83a1-da2f6360c983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:29.241190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:29.242258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:29.243162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:29.243162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:29.243162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:29.243162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:29.243162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 432/862] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:29.243979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723f6ea-41bb-4630-83a1-da2f6360c983 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:29.340809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7504286-45c5-4a02-8614-03d8c819e957 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.363483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723f6ea-41bb-4630-83a1-da2f6360c983 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.365970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:29.381764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca33e0-807f-46c9-a3fc-e6af3df72100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.382803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca33e0-807f-46c9-a3fc-e6af3df72100 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.383248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca33e0-807f-46c9-a3fc-e6af3df72100 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.383516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca33e0-807f-46c9-a3fc-e6af3df72100 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.384213 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca33e0-807f-46c9-a3fc-e6af3df72100 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.385670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca33e0-807f-46c9-a3fc-e6af3df72100 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1fca33e0-807f-46c9-a3fc-e6af3df72100 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:29.397717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:29.398772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:29.399655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 431/863] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:29.400490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca33e0-807f-46c9-a3fc-e6af3df72100 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:29.405969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768961bf-31d7-4f7f-9d33-4a32b9d7f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.406635 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768961bf-31d7-4f7f-9d33-4a32b9d7f76d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.406913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768961bf-31d7-4f7f-9d33-4a32b9d7f76d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.407185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768961bf-31d7-4f7f-9d33-4a32b9d7f76d None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.407917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768961bf-31d7-4f7f-9d33-4a32b9d7f76d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:29.408222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768961bf-31d7-4f7f-9d33-4a32b9d7f76d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.409599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768961bf-31d7-4f7f-9d33-4a32b9d7f76d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.420002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 433/864] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:29.421341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768961bf-31d7-4f7f-9d33-4a32b9d7f76d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:29.470827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:29.515054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca33e0-807f-46c9-a3fc-e6af3df72100 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.545040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768961bf-31d7-4f7f-9d33-4a32b9d7f76d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.552752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43b56c-b97a-4594-b1af-feadc5e272c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.553472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43b56c-b97a-4594-b1af-feadc5e272c2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.553705 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43b56c-b97a-4594-b1af-feadc5e272c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.553981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43b56c-b97a-4594-b1af-feadc5e272c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.554713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43b56c-b97a-4594-b1af-feadc5e272c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:29.555021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43b56c-b97a-4594-b1af-feadc5e272c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.556885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43b56c-b97a-4594-b1af-feadc5e272c2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.570091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 432/865] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:29.575709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43b56c-b97a-4594-b1af-feadc5e272c2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:29.589043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef385c2-3032-4b05-b301-35b262354307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.590641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef385c2-3032-4b05-b301-35b262354307 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.591111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef385c2-3032-4b05-b301-35b262354307 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.591544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef385c2-3032-4b05-b301-35b262354307 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.592583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef385c2-3032-4b05-b301-35b262354307 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:29.593062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef385c2-3032-4b05-b301-35b262354307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.594495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef385c2-3032-4b05-b301-35b262354307 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.606696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 434/866] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:29.608130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef385c2-3032-4b05-b301-35b262354307 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:29.647024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:29.706808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43b56c-b97a-4594-b1af-feadc5e272c2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.733000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:29.747214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec143d-868b-44b7-80bc-a1b84012191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.747970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef385c2-3032-4b05-b301-35b262354307 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.748089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec143d-868b-44b7-80bc-a1b84012191b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.748305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec143d-868b-44b7-80bc-a1b84012191b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.748576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec143d-868b-44b7-80bc-a1b84012191b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.757432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec143d-868b-44b7-80bc-a1b84012191b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.758929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec143d-868b-44b7-80bc-a1b84012191b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5cec143d-868b-44b7-80bc-a1b84012191b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:29.781888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:29.782858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:29.783843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:29.783843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:29.783843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:29.783843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:29.783843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:29.783843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:29.783843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:29.783843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:29.789859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 433/867] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:29.790346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec143d-868b-44b7-80bc-a1b84012191b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:29.796651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849df43-6dd0-46ae-b670-62d42ea3de4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.797627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849df43-6dd0-46ae-b670-62d42ea3de4e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.798135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849df43-6dd0-46ae-b670-62d42ea3de4e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.798628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849df43-6dd0-46ae-b670-62d42ea3de4e None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.799539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849df43-6dd0-46ae-b670-62d42ea3de4e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:29.800604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849df43-6dd0-46ae-b670-62d42ea3de4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.802679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849df43-6dd0-46ae-b670-62d42ea3de4e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.816006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 435/868] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:29.909210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec143d-868b-44b7-80bc-a1b84012191b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:29.945719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba1817-ea7d-4fa4-aabd-c96332ee8266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:29.946392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba1817-ea7d-4fa4-aabd-c96332ee8266 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:29.946673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba1817-ea7d-4fa4-aabd-c96332ee8266 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:29.946949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba1817-ea7d-4fa4-aabd-c96332ee8266 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:29.947780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba1817-ea7d-4fa4-aabd-c96332ee8266 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:29.948091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba1817-ea7d-4fa4-aabd-c96332ee8266 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:29.950117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba1817-ea7d-4fa4-aabd-c96332ee8266 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:29.966625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 434/869] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:29.972774 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849df43-6dd0-46ae-b670-62d42ea3de4e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:30.088930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:30.095925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849df43-6dd0-46ae-b670-62d42ea3de4e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:30.134609 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67547d38-8916-44e3-98aa-33b6b1f498eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:30.135274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547d38-8916-44e3-98aa-33b6b1f498eb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:30.135571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547d38-8916-44e3-98aa-33b6b1f498eb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:30.135857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67547d38-8916-44e3-98aa-33b6b1f498eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:30.137287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67547d38-8916-44e3-98aa-33b6b1f498eb None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=f8e7179f5fe945f4be1ca16263042b3f) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:30.137606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67547d38-8916-44e3-98aa-33b6b1f498eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:30.139042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67547d38-8916-44e3-98aa-33b6b1f498eb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:30.145933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 436/870] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:29 2022] GET /identity/v3/role_assignments?user.id=f8e7179f5fe945f4be1ca16263042b3f&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 610 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:31.202940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91376466-f579-4031-b3a9-d78acbd3e596 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:31.203478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91376466-f579-4031-b3a9-d78acbd3e596 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:31.203478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91376466-f579-4031-b3a9-d78acbd3e596 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:31.205016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 435/871] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:31.210606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce735-36dc-4bec-a745-e7f5b6c0859a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:31.211471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce735-36dc-4bec-a745-e7f5b6c0859a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:31.211978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ce735-36dc-4bec-a745-e7f5b6c0859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:31.232105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-328ce735-36dc-4bec-a745-e7f5b6c0859a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:31.233705 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-328ce735-36dc-4bec-a745-e7f5b6c0859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:31.306999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 437/872] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:31 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:31.330521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91376466-f579-4031-b3a9-d78acbd3e596 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:31.380530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:31.446605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91376466-f579-4031-b3a9-d78acbd3e596 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:31.483344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34491c31-e5d8-47bc-a273-3d1ab5c5adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:31.484203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34491c31-e5d8-47bc-a273-3d1ab5c5adb6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:31.484486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34491c31-e5d8-47bc-a273-3d1ab5c5adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:31.484762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34491c31-e5d8-47bc-a273-3d1ab5c5adb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:31.497149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34491c31-e5d8-47bc-a273-3d1ab5c5adb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-34491c31-e5d8-47bc-a273-3d1ab5c5adb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:31.505795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:31.506849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:31.508201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 436/873] 10.222.0.112 () {56 vars in 1125 bytes} [Fri Jun 3 16:14:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:31.514053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ce735-36dc-4bec-a745-e7f5b6c0859a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:31.613453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:31.625523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ce735-36dc-4bec-a745-e7f5b6c0859a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:31.662042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e7cf1-d1a3-4b6c-9745-c9c4ecaefaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:31.662770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7cf1-d1a3-4b6c-9745-c9c4ecaefaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:31.663047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7cf1-d1a3-4b6c-9745-c9c4ecaefaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:31.663321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e7cf1-d1a3-4b6c-9745-c9c4ecaefaf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:31.664152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e7cf1-d1a3-4b6c-9745-c9c4ecaefaf4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:31.664455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e7cf1-d1a3-4b6c-9745-c9c4ecaefaf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:31.665842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e7cf1-d1a3-4b6c-9745-c9c4ecaefaf4 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:31.674894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 438/874] 10.222.0.112 () {56 vars in 1120 bytes} [Fri Jun 3 16:14:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:31.680137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34491c31-e5d8-47bc-a273-3d1ab5c5adb6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:31.763739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7990da-042c-4e2c-897c-df85b33306f4 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:31.763936 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7990da-042c-4e2c-897c-df85b33306f4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:31.764214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7990da-042c-4e2c-897c-df85b33306f4 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:31.765951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 439/875] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:31.771411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16091531-b5fe-44a7-b001-5e439031cb7b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:31.771737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16091531-b5fe-44a7-b001-5e439031cb7b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:31.772022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16091531-b5fe-44a7-b001-5e439031cb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:31.789308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-16091531-b5fe-44a7-b001-5e439031cb7b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:31.790511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-16091531-b5fe-44a7-b001-5e439031cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:31.791185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34491c31-e5d8-47bc-a273-3d1ab5c5adb6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:31.793209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:31.830109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a9699-bd42-4d5f-9181-978f5b06307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:31.831300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a9699-bd42-4d5f-9181-978f5b06307b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:31.831829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a9699-bd42-4d5f-9181-978f5b06307b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:31.832308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a9699-bd42-4d5f-9181-978f5b06307b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:31.843957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a9699-bd42-4d5f-9181-978f5b06307b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:31.845769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a9699-bd42-4d5f-9181-978f5b06307b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-319a9699-bd42-4d5f-9181-978f5b06307b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:31.865397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:31.866433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:31.867368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:31.867368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:31.867368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:31.867368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:31.869916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 437/876] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:31.877001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a9699-bd42-4d5f-9181-978f5b06307b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:31.883665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 440/877] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:31 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:31.903848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16091531-b5fe-44a7-b001-5e439031cb7b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:32.010151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:32.021288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a9699-bd42-4d5f-9181-978f5b06307b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:32.035624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16091531-b5fe-44a7-b001-5e439031cb7b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:32.070013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23349d5-4d9f-4809-a1bf-af86381a9aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:32.070691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23349d5-4d9f-4809-a1bf-af86381a9aaf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.070976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23349d5-4d9f-4809-a1bf-af86381a9aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.071252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23349d5-4d9f-4809-a1bf-af86381a9aaf None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.072475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23349d5-4d9f-4809-a1bf-af86381a9aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:32.072788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23349d5-4d9f-4809-a1bf-af86381a9aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:32.075016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23349d5-4d9f-4809-a1bf-af86381a9aaf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:32.081859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e489b5-850f-45e0-bb23-04bf61a3db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:32.082831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e489b5-850f-45e0-bb23-04bf61a3db4c None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.083342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e489b5-850f-45e0-bb23-04bf61a3db4c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.083858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e489b5-850f-45e0-bb23-04bf61a3db4c None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.085311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e489b5-850f-45e0-bb23-04bf61a3db4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:32.087439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e489b5-850f-45e0-bb23-04bf61a3db4c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:32.094113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 438/878] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:32.096913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23349d5-4d9f-4809-a1bf-af86381a9aaf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:32.119778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 441/879] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:14:31 2022] POST /identity/v3/services => generated 270 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:32.122363 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:32.213532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a754d0-eb36-4d2e-867f-aa8934126836 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.214171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a754d0-eb36-4d2e-867f-aa8934126836 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.214171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a754d0-eb36-4d2e-867f-aa8934126836 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.215938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 442/880] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:32.216677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23349d5-4d9f-4809-a1bf-af86381a9aaf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:32.222591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec537d89-79f7-45a4-851f-0d5ce502aff8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.222940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec537d89-79f7-45a4-851f-0d5ce502aff8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.223155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec537d89-79f7-45a4-851f-0d5ce502aff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.248358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ec537d89-79f7-45a4-851f-0d5ce502aff8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:32.250175 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ec537d89-79f7-45a4-851f-0d5ce502aff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:32.265118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1196e49-7e70-4540-84cb-0d8185a40c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:32.266203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1196e49-7e70-4540-84cb-0d8185a40c54 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.266439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1196e49-7e70-4540-84cb-0d8185a40c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.266675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1196e49-7e70-4540-84cb-0d8185a40c54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.275087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1196e49-7e70-4540-84cb-0d8185a40c54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:32.276536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1196e49-7e70-4540-84cb-0d8185a40c54 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a1196e49-7e70-4540-84cb-0d8185a40c54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:32.294033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:32.295084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:32.296601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 439/881] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:14:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:32.301585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1196e49-7e70-4540-84cb-0d8185a40c54 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:32.341141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 443/882] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:32 2022] POST /identity/v3/auth/tokens => generated 1263 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:32.365325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec537d89-79f7-45a4-851f-0d5ce502aff8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:32.377574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:32.423871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1196e49-7e70-4540-84cb-0d8185a40c54 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:32.447093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:32.470553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65604a-3476-4706-8896-9040eaf45244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:32.472047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65604a-3476-4706-8896-9040eaf45244 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.472763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65604a-3476-4706-8896-9040eaf45244 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.473201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65604a-3476-4706-8896-9040eaf45244 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.474507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65604a-3476-4706-8896-9040eaf45244 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:32.474978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65604a-3476-4706-8896-9040eaf45244 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:32.477320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65604a-3476-4706-8896-9040eaf45244 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:32.486113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec537d89-79f7-45a4-851f-0d5ce502aff8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:32.502492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 440/883] 10.222.0.112 () {56 vars in 1154 bytes} [Fri Jun 3 16:14:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:32.511599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65604a-3476-4706-8896-9040eaf45244 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:32.530552 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9cb58-316b-4bce-8aba-2de3208ba395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:32.531253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9cb58-316b-4bce-8aba-2de3208ba395 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.531629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9cb58-316b-4bce-8aba-2de3208ba395 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.531971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9cb58-316b-4bce-8aba-2de3208ba395 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.532796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9cb58-316b-4bce-8aba-2de3208ba395 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:32.534323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9cb58-316b-4bce-8aba-2de3208ba395 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:32.555797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 444/884] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:14:32 2022] POST /identity/v3/services => generated 252 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:14:32.579472 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0eb33-b9a3-45c6-a46f-535b80df1ac4 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.579809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0eb33-b9a3-45c6-a46f-535b80df1ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.580092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0eb33-b9a3-45c6-a46f-535b80df1ac4 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.581680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 445/885] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:32.589089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173f0c3-c74a-42af-bb01-baf492119927 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.589944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173f0c3-c74a-42af-bb01-baf492119927 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.590242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173f0c3-c74a-42af-bb01-baf492119927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.614776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2173f0c3-c74a-42af-bb01-baf492119927 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:32.616405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2173f0c3-c74a-42af-bb01-baf492119927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:32.642672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65604a-3476-4706-8896-9040eaf45244 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:32.674193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:32.691171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0f8a-4d26-448e-a9b6-fb5bc501504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:32.692036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0f8a-4d26-448e-a9b6-fb5bc501504b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.692325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0f8a-4d26-448e-a9b6-fb5bc501504b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.692602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0f8a-4d26-448e-a9b6-fb5bc501504b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.726115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 446/886] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:32 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:32.748719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173f0c3-c74a-42af-bb01-baf492119927 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:32.798762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0f8a-4d26-448e-a9b6-fb5bc501504b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:32.800314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0f8a-4d26-448e-a9b6-fb5bc501504b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:32.824744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:32.873606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173f0c3-c74a-42af-bb01-baf492119927 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:32.913996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9a982-f171-4c4f-b841-0f65f79b7398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:32.914855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9a982-f171-4c4f-b841-0f65f79b7398 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:32.915389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9a982-f171-4c4f-b841-0f65f79b7398 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:32.915850 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9a982-f171-4c4f-b841-0f65f79b7398 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:32.916815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9a982-f171-4c4f-b841-0f65f79b7398 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:32.918594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9a982-f171-4c4f-b841-0f65f79b7398 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-4af9a982-f171-4c4f-b841-0f65f79b7398 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:32.931839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:32.932949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:32.934298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 447/887] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:32.936128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 441/888] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:32 2022] GET /identity/v3/auth/tokens => generated 1364 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 16:14:32.940513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9a982-f171-4c4f-b841-0f65f79b7398 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:32.944769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0f8a-4d26-448e-a9b6-fb5bc501504b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:32.981163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:33.064667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9a982-f171-4c4f-b841-0f65f79b7398 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:33.080179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0f8a-4d26-448e-a9b6-fb5bc501504b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:33.099989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:33.115392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeea8f-d6d7-48a4-b488-77cd11cabcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:33.116081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeea8f-d6d7-48a4-b488-77cd11cabcaf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:33.116372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeea8f-d6d7-48a4-b488-77cd11cabcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:33.116655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeea8f-d6d7-48a4-b488-77cd11cabcaf None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:33.117797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeea8f-d6d7-48a4-b488-77cd11cabcaf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:33.118136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeea8f-d6d7-48a4-b488-77cd11cabcaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:33.120166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeea8f-d6d7-48a4-b488-77cd11cabcaf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:33.123300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a20387-1f24-4436-a0bb-10007be3644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:33.124381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a20387-1f24-4436-a0bb-10007be3644c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:33.124874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a20387-1f24-4436-a0bb-10007be3644c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:33.125366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a20387-1f24-4436-a0bb-10007be3644c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:33.127585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 448/889] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:32 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:33.131846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeea8f-d6d7-48a4-b488-77cd11cabcaf None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:33.141327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a20387-1f24-4436-a0bb-10007be3644c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:33.142886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a20387-1f24-4436-a0bb-10007be3644c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-22a20387-1f24-4436-a0bb-10007be3644c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:33.162957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:33.163981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:33.164920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:33.164920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:33.164920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:33.164920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:33.169722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 442/890] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:33.170664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a20387-1f24-4436-a0bb-10007be3644c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:33.265945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeea8f-d6d7-48a4-b488-77cd11cabcaf None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:33.272198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:33.305969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a20387-1f24-4436-a0bb-10007be3644c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:33.306993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a4ac7-9362-4647-8640-6eb521661d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:33.307780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a4ac7-9362-4647-8640-6eb521661d23 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:33.308182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a4ac7-9362-4647-8640-6eb521661d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:33.308658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a4ac7-9362-4647-8640-6eb521661d23 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:33.309377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a4ac7-9362-4647-8640-6eb521661d23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:33.309752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a4ac7-9362-4647-8640-6eb521661d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:33.311257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a4ac7-9362-4647-8640-6eb521661d23 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:33.324181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 449/891] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:33 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:33.351618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72f7da-28d2-4279-a4ae-a9a54e3ebb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:33.352629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f7da-28d2-4279-a4ae-a9a54e3ebb61 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:33.353103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f7da-28d2-4279-a4ae-a9a54e3ebb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:33.353591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f7da-28d2-4279-a4ae-a9a54e3ebb61 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:33.354543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72f7da-28d2-4279-a4ae-a9a54e3ebb61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:33.355654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72f7da-28d2-4279-a4ae-a9a54e3ebb61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:33.357539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72f7da-28d2-4279-a4ae-a9a54e3ebb61 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:33.371678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 443/892] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:33.377226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a4ac7-9362-4647-8640-6eb521661d23 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:33.446323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:33.498180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a4ac7-9362-4647-8640-6eb521661d23 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:33.535274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa6789-8d21-49bd-a863-6f276492729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:33.536100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa6789-8d21-49bd-a863-6f276492729d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:33.536456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa6789-8d21-49bd-a863-6f276492729d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:33.536787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa6789-8d21-49bd-a863-6f276492729d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:33.544331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa6789-8d21-49bd-a863-6f276492729d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:33.545778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa6789-8d21-49bd-a863-6f276492729d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b1aa6789-8d21-49bd-a863-6f276492729d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:33.560129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:33.561086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:33.562159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:33.562159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:33.562159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:33.562159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:33.562159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:33.562159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:33.562159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:33.562159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:33.562159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 450/893] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:33.567160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72f7da-28d2-4279-a4ae-a9a54e3ebb61 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:33.676197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72f7da-28d2-4279-a4ae-a9a54e3ebb61 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:33.716071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fd318-f8f0-40f7-89c1-6354dab6d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:33.716988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fd318-f8f0-40f7-89c1-6354dab6d54c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:33.717425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fd318-f8f0-40f7-89c1-6354dab6d54c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:33.717873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fd318-f8f0-40f7-89c1-6354dab6d54c None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:33.718840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fd318-f8f0-40f7-89c1-6354dab6d54c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:33.719300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fd318-f8f0-40f7-89c1-6354dab6d54c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:33.720922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fd318-f8f0-40f7-89c1-6354dab6d54c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:33.723845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:33.738295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 444/894] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:33.744614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa6789-8d21-49bd-a863-6f276492729d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:33.857770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa6789-8d21-49bd-a863-6f276492729d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:33.873276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:33.895597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e732fde-b244-4215-89e3-dd270d01a0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:33.896311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e732fde-b244-4215-89e3-dd270d01a0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:33.896593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e732fde-b244-4215-89e3-dd270d01a0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:33.896922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e732fde-b244-4215-89e3-dd270d01a0a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:33.897761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e732fde-b244-4215-89e3-dd270d01a0a1 None admin] RBAC: Adding query filter params (role.id=cac2df5a53594fd4823118be07082990, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=9b44182e2e5b4b34bd549452c305c194) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:33.898072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e732fde-b244-4215-89e3-dd270d01a0a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:33.899508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e732fde-b244-4215-89e3-dd270d01a0a1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:33.905825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 451/895] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:33 2022] GET /identity/v3/role_assignments?user.id=9b44182e2e5b4b34bd549452c305c194&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=cac2df5a53594fd4823118be07082990 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:34.555334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a58ab-0908-41ae-bc08-9593b49b0cf3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:34.555849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a58ab-0908-41ae-bc08-9593b49b0cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:34.555849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a58ab-0908-41ae-bc08-9593b49b0cf3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:34.557476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 445/896] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:34.562913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada603d-c785-4326-a6fa-bd13574955f3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:34.563400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada603d-c785-4326-a6fa-bd13574955f3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:34.563483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada603d-c785-4326-a6fa-bd13574955f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:34.580972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2ada603d-c785-4326-a6fa-bd13574955f3 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:34.582170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2ada603d-c785-4326-a6fa-bd13574955f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:34.657548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 452/897] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:34 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:34.679949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a58ab-0908-41ae-bc08-9593b49b0cf3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:34.783236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a58ab-0908-41ae-bc08-9593b49b0cf3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:34.817043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933b9db-ead9-466a-961d-71447db61b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:34.817766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933b9db-ead9-466a-961d-71447db61b86 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:34.818046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933b9db-ead9-466a-961d-71447db61b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:34.818318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933b9db-ead9-466a-961d-71447db61b86 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:34.818964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933b9db-ead9-466a-961d-71447db61b86 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:34.820351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933b9db-ead9-466a-961d-71447db61b86 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b933b9db-ead9-466a-961d-71447db61b86 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:34.833014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:34.834006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:34.835299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 446/898] 10.222.0.112 () {56 vars in 1137 bytes} [Fri Jun 3 16:14:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:34.840365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada603d-c785-4326-a6fa-bd13574955f3 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:34.945446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2d4d-d964-43bf-b9d3-b8bc65b7184d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:34.945800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2d4d-d964-43bf-b9d3-b8bc65b7184d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:34.945905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada603d-c785-4326-a6fa-bd13574955f3 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:34.946067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc2d4d-d964-43bf-b9d3-b8bc65b7184d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:34.947683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 447/899] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:34.954215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f12b72-87fb-4a79-b2fb-9f0c852fbf5e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:34.954499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f12b72-87fb-4a79-b2fb-9f0c852fbf5e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:34.954777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f12b72-87fb-4a79-b2fb-9f0c852fbf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:34.959485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:34.972674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-25f12b72-87fb-4a79-b2fb-9f0c852fbf5e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:34.973849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-25f12b72-87fb-4a79-b2fb-9f0c852fbf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:34.988528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135486-2fbb-4d21-b301-9224285dd041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:34.989255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135486-2fbb-4d21-b301-9224285dd041 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:34.989536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135486-2fbb-4d21-b301-9224285dd041 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:34.989809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135486-2fbb-4d21-b301-9224285dd041 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:34.990548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6135486-2fbb-4d21-b301-9224285dd041 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:34.990833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6135486-2fbb-4d21-b301-9224285dd041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:34.992260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6135486-2fbb-4d21-b301-9224285dd041 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:34.997941 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 453/900] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:34 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:35.003290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135486-2fbb-4d21-b301-9224285dd041 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:35.051977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:35.062632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 448/901] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:34 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:35.085931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f12b72-87fb-4a79-b2fb-9f0c852fbf5e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:35.121347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135486-2fbb-4d21-b301-9224285dd041 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:35.157467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c58845-0bac-46d3-975b-20ad52d5ed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:35.158149 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c58845-0bac-46d3-975b-20ad52d5ed00 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:35.158431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c58845-0bac-46d3-975b-20ad52d5ed00 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:35.158708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c58845-0bac-46d3-975b-20ad52d5ed00 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:35.159431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c58845-0bac-46d3-975b-20ad52d5ed00 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:35.159774 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c58845-0bac-46d3-975b-20ad52d5ed00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:35.161159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c58845-0bac-46d3-975b-20ad52d5ed00 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:35.167191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 454/902] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:35 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:35.173529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c58845-0bac-46d3-975b-20ad52d5ed00 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:35.204253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f12b72-87fb-4a79-b2fb-9f0c852fbf5e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:35.226616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:35.243543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6e80-68e0-4620-b325-27fcd22853ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:35.244367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6e80-68e0-4620-b325-27fcd22853ea None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:35.244747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6e80-68e0-4620-b325-27fcd22853ea None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:35.245026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6e80-68e0-4620-b325-27fcd22853ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:35.246333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e6e80-68e0-4620-b325-27fcd22853ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:35.247822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e6e80-68e0-4620-b325-27fcd22853ea None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f31e6e80-68e0-4620-b325-27fcd22853ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:35.260688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:35.263059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 16:14:35.265098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:35.271660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 449/903] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:14:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:35.271660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6e80-68e0-4620-b325-27fcd22853ea None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:35.320821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c58845-0bac-46d3-975b-20ad52d5ed00 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:35.353494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:35.360227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8bbb-32ad-4bdc-8fbf-17049d9fc368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:35.361577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8bbb-32ad-4bdc-8fbf-17049d9fc368 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:35.362097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8bbb-32ad-4bdc-8fbf-17049d9fc368 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:35.362686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8bbb-32ad-4bdc-8fbf-17049d9fc368 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:35.363727 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af8bbb-32ad-4bdc-8fbf-17049d9fc368 None admin] RBAC: Adding query filter params (interface=public, service_id=80808e1665674f69a3e6561844c3348f, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:35.364415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af8bbb-32ad-4bdc-8fbf-17049d9fc368 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:35.367693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af8bbb-32ad-4bdc-8fbf-17049d9fc368 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:35.379780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 455/904] 10.222.0.112 () {56 vars in 1256 bytes} [Fri Jun 3 16:14:35 2022] GET /identity/v3/endpoints?service_id=80808e1665674f69a3e6561844c3348f&interface=public®ion_id=RegionOne => generated 195 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:35.382674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8bbb-32ad-4bdc-8fbf-17049d9fc368 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:35.425287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6e80-68e0-4620-b325-27fcd22853ea None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:35.467146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82427d26-9602-4153-a907-d3069334aa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:35.468023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82427d26-9602-4153-a907-d3069334aa5a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:35.468302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82427d26-9602-4153-a907-d3069334aa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:35.468574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82427d26-9602-4153-a907-d3069334aa5a None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:35.469453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82427d26-9602-4153-a907-d3069334aa5a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:35.469760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82427d26-9602-4153-a907-d3069334aa5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:35.471779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82427d26-9602-4153-a907-d3069334aa5a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:35.479639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 450/905] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:14:35 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:35.483535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82427d26-9602-4153-a907-d3069334aa5a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:35.516708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:35.521053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af8bbb-32ad-4bdc-8fbf-17049d9fc368 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:35.559860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62679a-6a8f-4750-a2b5-c043170cc8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:35.560739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62679a-6a8f-4750-a2b5-c043170cc8aa None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:35.561120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62679a-6a8f-4750-a2b5-c043170cc8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:35.561548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62679a-6a8f-4750-a2b5-c043170cc8aa None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:35.562276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62679a-6a8f-4750-a2b5-c043170cc8aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:35.563946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62679a-6a8f-4750-a2b5-c043170cc8aa None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:35.570246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 456/906] 10.222.0.112 () {56 vars in 1092 bytes} [Fri Jun 3 16:14:35 2022] GET /identity/v3/services => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:14:35.610973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82427d26-9602-4153-a907-d3069334aa5a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:35.633133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:35.655499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72bb07-468c-4e5d-931a-f74abb98ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:35.656522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72bb07-468c-4e5d-931a-f74abb98ee97 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:35.656961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72bb07-468c-4e5d-931a-f74abb98ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:35.657389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72bb07-468c-4e5d-931a-f74abb98ee97 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:35.658292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72bb07-468c-4e5d-931a-f74abb98ee97 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:35.658764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72bb07-468c-4e5d-931a-f74abb98ee97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:35.660369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72bb07-468c-4e5d-931a-f74abb98ee97 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:35.667009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 451/907] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:14:35 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:35.673030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62679a-6a8f-4750-a2b5-c043170cc8aa None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:35.720866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842d674-1547-4b21-a154-2b892723b19e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:35.721511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842d674-1547-4b21-a154-2b892723b19e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:35.722047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842d674-1547-4b21-a154-2b892723b19e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:35.724091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 452/908] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:35.730377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c26ee-2d0b-4cef-909b-eff8d0889af8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:35.730830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c26ee-2d0b-4cef-909b-eff8d0889af8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:35.731515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c26ee-2d0b-4cef-909b-eff8d0889af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:35.754013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-438c26ee-2d0b-4cef-909b-eff8d0889af8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:35.755617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-438c26ee-2d0b-4cef-909b-eff8d0889af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:35.809876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62679a-6a8f-4750-a2b5-c043170cc8aa None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:35.860096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 453/909] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:35 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:35.872483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de793454-1b91-4b36-a798-bf1e01e5223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:35.873566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de793454-1b91-4b36-a798-bf1e01e5223f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:35.874087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de793454-1b91-4b36-a798-bf1e01e5223f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:35.874561 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de793454-1b91-4b36-a798-bf1e01e5223f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:35.875932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de793454-1b91-4b36-a798-bf1e01e5223f None admin] RBAC: Adding query filter params (interface=public, service_id=0ff5a09f6f0242c58a04224a3f973882, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:35.876467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de793454-1b91-4b36-a798-bf1e01e5223f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:35.878238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de793454-1b91-4b36-a798-bf1e01e5223f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:35.882837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c26ee-2d0b-4cef-909b-eff8d0889af8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:35.885785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 457/910] 10.222.0.112 () {56 vars in 1256 bytes} [Fri Jun 3 16:14:35 2022] GET /identity/v3/endpoints?service_id=0ff5a09f6f0242c58a04224a3f973882&interface=public®ion_id=RegionOne => generated 195 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:35.893159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de793454-1b91-4b36-a798-bf1e01e5223f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:35.936315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:36.010994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c26ee-2d0b-4cef-909b-eff8d0889af8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:36.026321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de793454-1b91-4b36-a798-bf1e01e5223f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:36.029100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:36.062381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205fe3f-cd48-42ef-9fd3-a8114780710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:36.063351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205fe3f-cd48-42ef-9fd3-a8114780710e None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:36.063664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205fe3f-cd48-42ef-9fd3-a8114780710e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:36.063942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205fe3f-cd48-42ef-9fd3-a8114780710e None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:36.064698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205fe3f-cd48-42ef-9fd3-a8114780710e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:36.066087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205fe3f-cd48-42ef-9fd3-a8114780710e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:36.068618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8848f-eb75-4068-91db-e96080a43eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:36.069564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8848f-eb75-4068-91db-e96080a43eba None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:36.070051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8848f-eb75-4068-91db-e96080a43eba None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:36.070531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8848f-eb75-4068-91db-e96080a43eba None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:36.071692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8848f-eb75-4068-91db-e96080a43eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:36.074259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8848f-eb75-4068-91db-e96080a43eba None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:36.091660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 458/912] 10.222.0.112 () {56 vars in 1092 bytes} [Fri Jun 3 16:14:35 2022] GET /identity/v3/services => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:14:36.092052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 454/912] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:14:35 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:14:36.261037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e38aab-3fe4-498c-bcb8-7a37555d4f4c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:36.261943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e38aab-3fe4-498c-bcb8-7a37555d4f4c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:36.262146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e38aab-3fe4-498c-bcb8-7a37555d4f4c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:36.263876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 459/913] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:36.271592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bb9f1-52ab-4199-9e1a-094052319cc9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:36.271592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bb9f1-52ab-4199-9e1a-094052319cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:36.271592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bb9f1-52ab-4199-9e1a-094052319cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:36.289592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fc6bb9f1-52ab-4199-9e1a-094052319cc9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:36.291137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fc6bb9f1-52ab-4199-9e1a-094052319cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:36.377227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 455/914] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:36 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:36.400061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e38aab-3fe4-498c-bcb8-7a37555d4f4c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:36.501255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:36.512773 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e38aab-3fe4-498c-bcb8-7a37555d4f4c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:36.549198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9987-574c-40f4-a647-627998de3ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:36.550009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9987-574c-40f4-a647-627998de3ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:36.550294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9987-574c-40f4-a647-627998de3ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:36.550567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee9987-574c-40f4-a647-627998de3ff0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:36.562197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee9987-574c-40f4-a647-627998de3ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-27ee9987-574c-40f4-a647-627998de3ff0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:36.570436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:36.571853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:36.572722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:36.575674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 460/915] 10.222.0.112 () {56 vars in 1125 bytes} [Fri Jun 3 16:14:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:36.578100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bb9f1-52ab-4199-9e1a-094052319cc9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:36.678879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:36.682977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bb9f1-52ab-4199-9e1a-094052319cc9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:36.721287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e12b-b952-4b27-b31b-f19e0cb37c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:36.721963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e12b-b952-4b27-b31b-f19e0cb37c4a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:36.722248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e12b-b952-4b27-b31b-f19e0cb37c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:36.722524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05e12b-b952-4b27-b31b-f19e0cb37c4a None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:36.723281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e12b-b952-4b27-b31b-f19e0cb37c4a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:36.723612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e12b-b952-4b27-b31b-f19e0cb37c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:36.725013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05e12b-b952-4b27-b31b-f19e0cb37c4a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:36.734932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 456/916] 10.222.0.112 () {56 vars in 1120 bytes} [Fri Jun 3 16:14:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:36.740679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9987-574c-40f4-a647-627998de3ff0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:36.849974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee9987-574c-40f4-a647-627998de3ff0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:36.885118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2f1fa-2813-4ed0-943b-2a2b14f25a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:36.885919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f1fa-2813-4ed0-943b-2a2b14f25a76 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:36.886268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f1fa-2813-4ed0-943b-2a2b14f25a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:36.886543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2f1fa-2813-4ed0-943b-2a2b14f25a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:36.897747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2f1fa-2813-4ed0-943b-2a2b14f25a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:36.899280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2f1fa-2813-4ed0-943b-2a2b14f25a76 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-69f2f1fa-2813-4ed0-943b-2a2b14f25a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:36.919087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:36.920338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:36.921464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:36.921464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:36.921464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:36.921464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:36.925373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 461/917] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:36.926776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e12b-b952-4b27-b31b-f19e0cb37c4a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:37.038945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05e12b-b952-4b27-b31b-f19e0cb37c4a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:37.074002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ac5a3-f00f-41f0-bb60-c78391a3f35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:37.074673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ac5a3-f00f-41f0-bb60-c78391a3f35c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:37.074959 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ac5a3-f00f-41f0-bb60-c78391a3f35c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:37.075236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ac5a3-f00f-41f0-bb60-c78391a3f35c None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:37.075991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ac5a3-f00f-41f0-bb60-c78391a3f35c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:37.076299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ac5a3-f00f-41f0-bb60-c78391a3f35c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:37.077685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ac5a3-f00f-41f0-bb60-c78391a3f35c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:37.090919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 457/918] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:37.096441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2f1fa-2813-4ed0-943b-2a2b14f25a76 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:37.116495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:37.201300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2f1fa-2813-4ed0-943b-2a2b14f25a76 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:37.237377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39023-f10a-498b-ac44-efba4bda3e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:37.238245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39023-f10a-498b-ac44-efba4bda3e23 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:37.238530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39023-f10a-498b-ac44-efba4bda3e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:37.238806 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39023-f10a-498b-ac44-efba4bda3e23 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:37.247007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c39023-f10a-498b-ac44-efba4bda3e23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:37.248497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c39023-f10a-498b-ac44-efba4bda3e23 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-02c39023-f10a-498b-ac44-efba4bda3e23 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:37.264135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:37.265129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:37.266088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:37.270112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 462/919] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:14:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:37.271664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ac5a3-f00f-41f0-bb60-c78391a3f35c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:37.295019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:37.383663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ac5a3-f00f-41f0-bb60-c78391a3f35c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:37.421797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ada4-5f2a-4e64-ae26-92eda30f9a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:37.422744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ada4-5f2a-4e64-ae26-92eda30f9a43 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:37.423179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ada4-5f2a-4e64-ae26-92eda30f9a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:37.423646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83ada4-5f2a-4e64-ae26-92eda30f9a43 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:37.424654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83ada4-5f2a-4e64-ae26-92eda30f9a43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:37.425115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83ada4-5f2a-4e64-ae26-92eda30f9a43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:37.426693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83ada4-5f2a-4e64-ae26-92eda30f9a43 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:37.445358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 458/920] 10.222.0.112 () {56 vars in 1154 bytes} [Fri Jun 3 16:14:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:37.455616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39023-f10a-498b-ac44-efba4bda3e23 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:37.520839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:37.556878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39023-f10a-498b-ac44-efba4bda3e23 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:37.592474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf73b20-bdb2-4e74-95aa-001e4884110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:37.593270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf73b20-bdb2-4e74-95aa-001e4884110a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:37.593554 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf73b20-bdb2-4e74-95aa-001e4884110a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:37.593834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf73b20-bdb2-4e74-95aa-001e4884110a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:37.604959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf73b20-bdb2-4e74-95aa-001e4884110a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:37.606754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf73b20-bdb2-4e74-95aa-001e4884110a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5cf73b20-bdb2-4e74-95aa-001e4884110a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:37.624899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:37.625835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:37.626757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:37.626757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:37.626757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:37.626757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:37.630885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 463/921] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:37.632278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ada4-5f2a-4e64-ae26-92eda30f9a43 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:37.723153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:37.753790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83ada4-5f2a-4e64-ae26-92eda30f9a43 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:37.789943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34505b-7d55-4c54-bb1e-161175b5d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:37.790601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34505b-7d55-4c54-bb1e-161175b5d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:37.790884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34505b-7d55-4c54-bb1e-161175b5d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:37.791160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34505b-7d55-4c54-bb1e-161175b5d6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:37.791958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34505b-7d55-4c54-bb1e-161175b5d6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:37.792297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34505b-7d55-4c54-bb1e-161175b5d6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:37.793723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34505b-7d55-4c54-bb1e-161175b5d6f8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:37.805904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 459/922] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:37.811894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf73b20-bdb2-4e74-95aa-001e4884110a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:37.916804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf73b20-bdb2-4e74-95aa-001e4884110a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:37.935461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:37.955176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2eb45-ce16-4d64-b88b-558eee905a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:37.956002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2eb45-ce16-4d64-b88b-558eee905a39 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:37.956275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2eb45-ce16-4d64-b88b-558eee905a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:37.956561 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2eb45-ce16-4d64-b88b-558eee905a39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:37.963703 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2eb45-ce16-4d64-b88b-558eee905a39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:37.965734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2eb45-ce16-4d64-b88b-558eee905a39 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-cca2eb45-ce16-4d64-b88b-558eee905a39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:37.980434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:37.981652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:37.982583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:37.982583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:37.982583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:37.982583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:37.982583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:37.982583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:37.982583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:37.982583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:37.986559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 464/923] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:37.987933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34505b-7d55-4c54-bb1e-161175b5d6f8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:38.048515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065655f8-b423-4863-acd4-41364866e2d8 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.048788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065655f8-b423-4863-acd4-41364866e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.049073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065655f8-b423-4863-acd4-41364866e2d8 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.050734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 465/924] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:38.057428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb2c2-7007-4100-af3a-4b96c56c9002 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.057924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb2c2-7007-4100-af3a-4b96c56c9002 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.058287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb2c2-7007-4100-af3a-4b96c56c9002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.076682 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-08bbb2c2-7007-4100-af3a-4b96c56c9002 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:38.078096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-08bbb2c2-7007-4100-af3a-4b96c56c9002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:38.102715 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34505b-7d55-4c54-bb1e-161175b5d6f8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:38.140143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4645-6ecf-4293-9901-82d86745d602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:38.140920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4645-6ecf-4293-9901-82d86745d602 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.141275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4645-6ecf-4293-9901-82d86745d602 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.141880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4645-6ecf-4293-9901-82d86745d602 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.142478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a4645-6ecf-4293-9901-82d86745d602 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:38.142853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a4645-6ecf-4293-9901-82d86745d602 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:38.144402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a4645-6ecf-4293-9901-82d86745d602 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:38.154249 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:38.169952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 460/925] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:38.171172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4645-6ecf-4293-9901-82d86745d602 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:38.181570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 466/926] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:38 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:38.205476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbb2c2-7007-4100-af3a-4b96c56c9002 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:38.295874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4645-6ecf-4293-9901-82d86745d602 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:38.336883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbb2c2-7007-4100-af3a-4b96c56c9002 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:38.342681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71762044-3035-49e1-8ec3-ec5666183642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:38.343598 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71762044-3035-49e1-8ec3-ec5666183642 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.343875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71762044-3035-49e1-8ec3-ec5666183642 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.344147 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71762044-3035-49e1-8ec3-ec5666183642 None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/9b44182e2e5b4b34bd549452c305c194/roles/cac2df5a53594fd4823118be07082990` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.346315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:38.347905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71762044-3035-49e1-8ec3-ec5666183642 None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=9b44182e2e5b4b34bd549452c305c194, role_id=cac2df5a53594fd4823118be07082990)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:38.350191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71762044-3035-49e1-8ec3-ec5666183642 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:38.375596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 461/927] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:14:38 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/9b44182e2e5b4b34bd549452c305c194/roles/cac2df5a53594fd4823118be07082990 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:14:38.390266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78dffd-ef71-4732-9f49-50161489ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:38.391653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78dffd-ef71-4732-9f49-50161489ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.392147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78dffd-ef71-4732-9f49-50161489ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.392680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78dffd-ef71-4732-9f49-50161489ffd1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.393586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78dffd-ef71-4732-9f49-50161489ffd1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:38.395330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78dffd-ef71-4732-9f49-50161489ffd1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-de78dffd-ef71-4732-9f49-50161489ffd1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:38.410113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:38.411196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 16:14:38.412308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:38.416410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 467/928] 10.222.0.112 () {56 vars in 1137 bytes} [Fri Jun 3 16:14:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:38.422791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71762044-3035-49e1-8ec3-ec5666183642 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:38.497965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:38.531366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca936-7293-4801-9213-11f77fc481f6 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.531732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca936-7293-4801-9213-11f77fc481f6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.532002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca936-7293-4801-9213-11f77fc481f6 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.533704 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 468/929] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:38.539821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace22e-8458-4d0b-adb0-bdbc992d0001 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.540121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace22e-8458-4d0b-adb0-bdbc992d0001 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.540371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace22e-8458-4d0b-adb0-bdbc992d0001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.556653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71762044-3035-49e1-8ec3-ec5666183642 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:38.563842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-57ace22e-8458-4d0b-adb0-bdbc992d0001 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:38.565125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-57ace22e-8458-4d0b-adb0-bdbc992d0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:38.601414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2159bd-72ca-47f7-8bd9-68629a0c1bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:38.602453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2159bd-72ca-47f7-8bd9-68629a0c1bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.603050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2159bd-72ca-47f7-8bd9-68629a0c1bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.603530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2159bd-72ca-47f7-8bd9-68629a0c1bc2 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.604544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2159bd-72ca-47f7-8bd9-68629a0c1bc2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:38.605657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2159bd-72ca-47f7-8bd9-68629a0c1bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:38.607526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2159bd-72ca-47f7-8bd9-68629a0c1bc2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:38.613517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 462/930] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:38 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:38.615096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e6666-8e2b-4a61-88b7-df938bc0aeeb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.615624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e6666-8e2b-4a61-88b7-df938bc0aeeb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.616108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e6666-8e2b-4a61-88b7-df938bc0aeeb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.617803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 463/931] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:38.620138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e6666-8e2b-4a61-88b7-df938bc0aeeb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:38.691577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 469/932] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:38 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:38.691577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b6ef3-4034-4684-a63f-e16ada50d76d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.691577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b6ef3-4034-4684-a63f-e16ada50d76d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.691577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b6ef3-4034-4684-a63f-e16ada50d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.721382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-607b6ef3-4034-4684-a63f-e16ada50d76d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:38.723252 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-607b6ef3-4034-4684-a63f-e16ada50d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:38.768485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e6666-8e2b-4a61-88b7-df938bc0aeeb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:38.794802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:38.809458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda61b05-16f5-4a25-b079-726671eaf764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:38.810040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda61b05-16f5-4a25-b079-726671eaf764 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.810319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda61b05-16f5-4a25-b079-726671eaf764 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.810593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda61b05-16f5-4a25-b079-726671eaf764 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.811326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda61b05-16f5-4a25-b079-726671eaf764 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:38.811643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda61b05-16f5-4a25-b079-726671eaf764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:38.813018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda61b05-16f5-4a25-b079-726671eaf764 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:38.814242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 470/933] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:38 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:38.823604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 464/934] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:38 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:38.823604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda61b05-16f5-4a25-b079-726671eaf764 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:38.826347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b6ef3-4034-4684-a63f-e16ada50d76d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:38.875227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:38.948868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda61b05-16f5-4a25-b079-726671eaf764 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:38.978598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b6ef3-4034-4684-a63f-e16ada50d76d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:38.996832 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbb24e-3edb-4fcd-9d9f-3fecdb4ef176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:38.997801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbb24e-3edb-4fcd-9d9f-3fecdb4ef176 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:38.998595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbb24e-3edb-4fcd-9d9f-3fecdb4ef176 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:38.998878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbb24e-3edb-4fcd-9d9f-3fecdb4ef176 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:38.999844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbb24e-3edb-4fcd-9d9f-3fecdb4ef176 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.001296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbb24e-3edb-4fcd-9d9f-3fecdb4ef176 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-cabbb24e-3edb-4fcd-9d9f-3fecdb4ef176 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:39.017300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:39.018595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:39.019471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 465/935] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:14:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:39.020332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbb24e-3edb-4fcd-9d9f-3fecdb4ef176 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:39.030639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c021c-f499-4d0c-bb4c-06bcd18967d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:39.031299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c021c-f499-4d0c-bb4c-06bcd18967d3 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:39.031719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c021c-f499-4d0c-bb4c-06bcd18967d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:39.032102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c021c-f499-4d0c-bb4c-06bcd18967d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:39.032997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c021c-f499-4d0c-bb4c-06bcd18967d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.035411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c021c-f499-4d0c-bb4c-06bcd18967d3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.057452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 471/936] 10.222.0.112 () {60 vars in 1149 bytes} [Fri Jun 3 16:14:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:39.059096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c021c-f499-4d0c-bb4c-06bcd18967d3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:39.087245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:39.150627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbb24e-3edb-4fcd-9d9f-3fecdb4ef176 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:39.203876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f92cd-3d8a-411d-aea7-2dd61186ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:39.204920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f92cd-3d8a-411d-aea7-2dd61186ef4a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:39.205208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f92cd-3d8a-411d-aea7-2dd61186ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:39.205483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f92cd-3d8a-411d-aea7-2dd61186ef4a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:39.206152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f92cd-3d8a-411d-aea7-2dd61186ef4a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.206580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:39.208052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f92cd-3d8a-411d-aea7-2dd61186ef4a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b32f92cd-3d8a-411d-aea7-2dd61186ef4a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:39.228171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:39.229280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:39.230202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 466/937] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:39.233559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c021c-f499-4d0c-bb4c-06bcd18967d3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:39.236116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f92cd-3d8a-411d-aea7-2dd61186ef4a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:39.273753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54adc2-f2c3-4e05-bbb2-7cb36b56af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:39.274439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54adc2-f2c3-4e05-bbb2-7cb36b56af8a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:39.274726 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54adc2-f2c3-4e05-bbb2-7cb36b56af8a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:39.274982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54adc2-f2c3-4e05-bbb2-7cb36b56af8a None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:39.275747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54adc2-f2c3-4e05-bbb2-7cb36b56af8a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:39.276058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54adc2-f2c3-4e05-bbb2-7cb36b56af8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.277510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54adc2-f2c3-4e05-bbb2-7cb36b56af8a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.283590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 472/938] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:14:39 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:39.289559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54adc2-f2c3-4e05-bbb2-7cb36b56af8a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:39.363544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f92cd-3d8a-411d-aea7-2dd61186ef4a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:39.377279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:39.404401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd45160-bf86-415d-a7f1-801d1f64d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:39.405068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd45160-bf86-415d-a7f1-801d1f64d524 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:39.405353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd45160-bf86-415d-a7f1-801d1f64d524 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:39.405630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd45160-bf86-415d-a7f1-801d1f64d524 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:39.406563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd45160-bf86-415d-a7f1-801d1f64d524 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:39.406685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd45160-bf86-415d-a7f1-801d1f64d524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.408073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd45160-bf86-415d-a7f1-801d1f64d524 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.413427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 467/939] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:39 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:39.418939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd45160-bf86-415d-a7f1-801d1f64d524 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:39.426666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54adc2-f2c3-4e05-bbb2-7cb36b56af8a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:39.472233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac92f-2e07-4b40-bd4c-1e0f38ee2c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:39.472905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac92f-2e07-4b40-bd4c-1e0f38ee2c33 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:39.473192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac92f-2e07-4b40-bd4c-1e0f38ee2c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:39.473476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac92f-2e07-4b40-bd4c-1e0f38ee2c33 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:39.474633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac92f-2e07-4b40-bd4c-1e0f38ee2c33 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:39.474945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac92f-2e07-4b40-bd4c-1e0f38ee2c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.476825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac92f-2e07-4b40-bd4c-1e0f38ee2c33 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.485028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 473/940] 10.222.0.112 () {56 vars in 1119 bytes} [Fri Jun 3 16:14:39 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:39.492534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac92f-2e07-4b40-bd4c-1e0f38ee2c33 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:39.519985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:39.532267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd45160-bf86-415d-a7f1-801d1f64d524 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:39.570502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f0146-7381-416d-a3dd-cc893cd5e67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:39.571600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f0146-7381-416d-a3dd-cc893cd5e67e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:39.571972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f0146-7381-416d-a3dd-cc893cd5e67e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:39.572408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f0146-7381-416d-a3dd-cc893cd5e67e None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:39.573280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f0146-7381-416d-a3dd-cc893cd5e67e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:39.573654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f0146-7381-416d-a3dd-cc893cd5e67e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.575271 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f0146-7381-416d-a3dd-cc893cd5e67e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.586041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 468/941] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:39 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:39.587346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f0146-7381-416d-a3dd-cc893cd5e67e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:39.606950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac92f-2e07-4b40-bd4c-1e0f38ee2c33 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:39.645376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:39.651864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177330-2f35-4bf6-8433-e4d062cb571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:39.653429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177330-2f35-4bf6-8433-e4d062cb571f None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:39.654387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177330-2f35-4bf6-8433-e4d062cb571f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:39.654987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e177330-2f35-4bf6-8433-e4d062cb571f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:39.656097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e177330-2f35-4bf6-8433-e4d062cb571f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.658410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e177330-2f35-4bf6-8433-e4d062cb571f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.687774 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 474/942] 10.222.0.112 () {60 vars in 1149 bytes} [Fri Jun 3 16:14:39 2022] POST /identity/v3/endpoints => generated 348 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:39.724226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f0146-7381-416d-a3dd-cc893cd5e67e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:39.774375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9227-d848-4ac5-b1e1-b7e006c803c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:39.775054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9227-d848-4ac5-b1e1-b7e006c803c5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:39.775345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9227-d848-4ac5-b1e1-b7e006c803c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:39.775677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9227-d848-4ac5-b1e1-b7e006c803c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:39.777028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9227-d848-4ac5-b1e1-b7e006c803c5 None admin] RBAC: Adding query filter params (interface=public, service_id=9fe6c09b4d0b4892bc9e5b8f11764a47, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:39.777370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9227-d848-4ac5-b1e1-b7e006c803c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.778861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9227-d848-4ac5-b1e1-b7e006c803c5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.785538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 469/943] 10.222.0.112 () {56 vars in 1256 bytes} [Fri Jun 3 16:14:39 2022] GET /identity/v3/endpoints?service_id=9fe6c09b4d0b4892bc9e5b8f11764a47&interface=public®ion_id=RegionOne => generated 195 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:39.791241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177330-2f35-4bf6-8433-e4d062cb571f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:39.872848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:39.909036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e177330-2f35-4bf6-8433-e4d062cb571f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:39.946275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f00bf9-c362-4e15-82a8-85adf304fd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:39.947299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00bf9-c362-4e15-82a8-85adf304fd33 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:39.947823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00bf9-c362-4e15-82a8-85adf304fd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:39.948324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00bf9-c362-4e15-82a8-85adf304fd33 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:39.949247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f00bf9-c362-4e15-82a8-85adf304fd33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:39.950868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f00bf9-c362-4e15-82a8-85adf304fd33 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:39.957998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 475/944] 10.222.0.112 () {56 vars in 1092 bytes} [Fri Jun 3 16:14:39 2022] GET /identity/v3/services => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:14:40.788803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dc400-d718-46d7-a629-771298feccbc None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:40.789345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dc400-d718-46d7-a629-771298feccbc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:40.789345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dc400-d718-46d7-a629-771298feccbc None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:40.791033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 470/945] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:40.797326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa5791-e318-49b9-bb7f-7bf695856a8c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:40.797798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa5791-e318-49b9-bb7f-7bf695856a8c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:40.797880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa5791-e318-49b9-bb7f-7bf695856a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:40.815132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-43aa5791-e318-49b9-bb7f-7bf695856a8c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:40.816364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-43aa5791-e318-49b9-bb7f-7bf695856a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:40.888494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 476/946] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:40 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:40.912377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dc400-d718-46d7-a629-771298feccbc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:41.017486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:41.022181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dc400-d718-46d7-a629-771298feccbc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:41.058655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8fa7f-a3a3-4e1c-9072-751b5a1062ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:41.059875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8fa7f-a3a3-4e1c-9072-751b5a1062ee None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:41.060369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8fa7f-a3a3-4e1c-9072-751b5a1062ee None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:41.060860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8fa7f-a3a3-4e1c-9072-751b5a1062ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:41.073005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8fa7f-a3a3-4e1c-9072-751b5a1062ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3ce8fa7f-a3a3-4e1c-9072-751b5a1062ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:41.082350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:41.083365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:41.084267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:41.087112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 471/947] 10.222.0.112 () {56 vars in 1125 bytes} [Fri Jun 3 16:14:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:41.093311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa5791-e318-49b9-bb7f-7bf695856a8c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:41.166702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:41.205194 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa5791-e318-49b9-bb7f-7bf695856a8c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:41.243241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9c923-06fe-4d0e-a8cc-fa1a5345bf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:41.243953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c923-06fe-4d0e-a8cc-fa1a5345bf19 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:41.244237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c923-06fe-4d0e-a8cc-fa1a5345bf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:41.244531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9c923-06fe-4d0e-a8cc-fa1a5345bf19 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:41.245798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9c923-06fe-4d0e-a8cc-fa1a5345bf19 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:41.246110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9c923-06fe-4d0e-a8cc-fa1a5345bf19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:41.247500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9c923-06fe-4d0e-a8cc-fa1a5345bf19 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:41.256577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 477/948] 10.222.0.112 () {56 vars in 1120 bytes} [Fri Jun 3 16:14:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:41.262721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8fa7f-a3a3-4e1c-9072-751b5a1062ee None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:41.375224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8fa7f-a3a3-4e1c-9072-751b5a1062ee None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:41.411331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83c2c7-4051-4077-968e-36ba6e20f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:41.412514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83c2c7-4051-4077-968e-36ba6e20f296 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:41.413007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83c2c7-4051-4077-968e-36ba6e20f296 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:41.413486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83c2c7-4051-4077-968e-36ba6e20f296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:41.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83c2c7-4051-4077-968e-36ba6e20f296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:41.426251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83c2c7-4051-4077-968e-36ba6e20f296 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4c83c2c7-4051-4077-968e-36ba6e20f296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:41.449889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:41.450879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:41.452220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:41.452220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:41.452220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:41.452220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:41.454233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 472/949] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:41.463571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9c923-06fe-4d0e-a8cc-fa1a5345bf19 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:41.545977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7065d6-bad1-45fe-8799-7e73638076a9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:41.546328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7065d6-bad1-45fe-8799-7e73638076a9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:41.546535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7065d6-bad1-45fe-8799-7e73638076a9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:41.548328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 473/950] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:41.553512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262bc35-a84c-4853-aab4-0976161f96ce None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:41.553799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262bc35-a84c-4853-aab4-0976161f96ce None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:41.554084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262bc35-a84c-4853-aab4-0976161f96ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:41.569538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9c923-06fe-4d0e-a8cc-fa1a5345bf19 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:41.575955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e262bc35-a84c-4853-aab4-0976161f96ce None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:41.577378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e262bc35-a84c-4853-aab4-0976161f96ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:41.581683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:41.602125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:41.620869 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43295d2-a46e-421d-b1fc-357270a66fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:41.621928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43295d2-a46e-421d-b1fc-357270a66fbb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:41.622505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43295d2-a46e-421d-b1fc-357270a66fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:41.622982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43295d2-a46e-421d-b1fc-357270a66fbb None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:41.623998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43295d2-a46e-421d-b1fc-357270a66fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:41.624510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43295d2-a46e-421d-b1fc-357270a66fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:41.626146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43295d2-a46e-421d-b1fc-357270a66fbb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:41.640084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 478/951] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:41.645883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43295d2-a46e-421d-b1fc-357270a66fbb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:41.675723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 474/952] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:41 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:41.699257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262bc35-a84c-4853-aab4-0976161f96ce None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:41.784171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43295d2-a46e-421d-b1fc-357270a66fbb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:41.821292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262bc35-a84c-4853-aab4-0976161f96ce None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:41.829496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c8ffc-f6b7-4854-94fd-4e0eb79eda90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:41.830491 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c8ffc-f6b7-4854-94fd-4e0eb79eda90 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:41.830875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c8ffc-f6b7-4854-94fd-4e0eb79eda90 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:41.831255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c8ffc-f6b7-4854-94fd-4e0eb79eda90 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:41.839142 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c8ffc-f6b7-4854-94fd-4e0eb79eda90 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:41.840787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c8ffc-f6b7-4854-94fd-4e0eb79eda90 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-714c8ffc-f6b7-4854-94fd-4e0eb79eda90 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:41.857852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:41.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 16:14:41.860320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:41.861929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 479/953] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:14:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:41.867597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c8ffc-f6b7-4854-94fd-4e0eb79eda90 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:41.868941 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d8355-4979-43db-9b74-5a4cfc031424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:41.869906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d8355-4979-43db-9b74-5a4cfc031424 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:41.870923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d8355-4979-43db-9b74-5a4cfc031424 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:41.871692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d8355-4979-43db-9b74-5a4cfc031424 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:41.873504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d8355-4979-43db-9b74-5a4cfc031424 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:41.875066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d8355-4979-43db-9b74-5a4cfc031424 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-292d8355-4979-43db-9b74-5a4cfc031424 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:41.891044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:41.892337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 16:14:41.893401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:41.901573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 475/954] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:41.902818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d8355-4979-43db-9b74-5a4cfc031424 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:41.908449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:41.936351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:42.009324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c8ffc-f6b7-4854-94fd-4e0eb79eda90 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:42.049756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d8355-4979-43db-9b74-5a4cfc031424 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:42.060416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1a29-1999-4016-b67f-e632da91d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:42.061524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1a29-1999-4016-b67f-e632da91d70d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.062071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1a29-1999-4016-b67f-e632da91d70d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.062628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1a29-1999-4016-b67f-e632da91d70d None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.064276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a1a29-1999-4016-b67f-e632da91d70d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:42.064911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a1a29-1999-4016-b67f-e632da91d70d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:42.067046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a1a29-1999-4016-b67f-e632da91d70d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:42.090142 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 480/955] 10.222.0.112 () {56 vars in 1154 bytes} [Fri Jun 3 16:14:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:42.097325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1a29-1999-4016-b67f-e632da91d70d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:42.100558 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3d8d5-2cf1-415f-a29b-0f01a594e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:42.101236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3d8d5-2cf1-415f-a29b-0f01a594e670 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.101513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3d8d5-2cf1-415f-a29b-0f01a594e670 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.101793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3d8d5-2cf1-415f-a29b-0f01a594e670 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.102866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3d8d5-2cf1-415f-a29b-0f01a594e670 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:42.103176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3d8d5-2cf1-415f-a29b-0f01a594e670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:42.105675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3d8d5-2cf1-415f-a29b-0f01a594e670 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:42.111878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 476/956] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:41 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:42.113582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a96c3-378b-4c7a-ba20-f895a8e86707 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.113877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a96c3-378b-4c7a-ba20-f895a8e86707 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.114156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a96c3-378b-4c7a-ba20-f895a8e86707 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.115781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 477/957] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:42.117842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a96c3-378b-4c7a-ba20-f895a8e86707 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:42.202136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:42.224412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1a29-1999-4016-b67f-e632da91d70d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:42.228184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:42.246088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a96c3-378b-4c7a-ba20-f895a8e86707 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:42.268245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f0770-e66f-411a-a063-3c61a4bd6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:42.269014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f0770-e66f-411a-a063-3c61a4bd6285 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.269292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f0770-e66f-411a-a063-3c61a4bd6285 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.269578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f0770-e66f-411a-a063-3c61a4bd6285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.284766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe124d5-c00c-4729-ad14-ef1576243fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:42.285449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe124d5-c00c-4729-ad14-ef1576243fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.285896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe124d5-c00c-4729-ad14-ef1576243fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.286315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe124d5-c00c-4729-ad14-ef1576243fc6 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.287044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe124d5-c00c-4729-ad14-ef1576243fc6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:42.287349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe124d5-c00c-4729-ad14-ef1576243fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:42.289346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe124d5-c00c-4729-ad14-ef1576243fc6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:42.294382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 478/958] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:42 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:42.295439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cf42e-d11c-4e8c-a420-a12f639e9773 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.295761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cf42e-d11c-4e8c-a420-a12f639e9773 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.296036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cf42e-d11c-4e8c-a420-a12f639e9773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.315210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-668cf42e-d11c-4e8c-a420-a12f639e9773 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:42.316480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-668cf42e-d11c-4e8c-a420-a12f639e9773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:42.379989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f0770-e66f-411a-a063-3c61a4bd6285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:42.381542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f0770-e66f-411a-a063-3c61a4bd6285 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:42.399526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 479/959] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:42 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:42.400951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803db94c-8109-45fb-bafb-0afbdc45b1ce None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.401235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803db94c-8109-45fb-bafb-0afbdc45b1ce None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.401600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803db94c-8109-45fb-bafb-0afbdc45b1ce None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.403057 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 480/960] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:42.411591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d426b6d-3f61-4ba4-9ea4-e60eb030bf49 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.411591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d426b6d-3f61-4ba4-9ea4-e60eb030bf49 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.411591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d426b6d-3f61-4ba4-9ea4-e60eb030bf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.429014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3d426b6d-3f61-4ba4-9ea4-e60eb030bf49 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:42.430162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3d426b6d-3f61-4ba4-9ea4-e60eb030bf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:42.499879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:42.514088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 481/961] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:42 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:42.516408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 481/962] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:42 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:14:42.516541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d426b6d-3f61-4ba4-9ea4-e60eb030bf49 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:42.521865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f0770-e66f-411a-a063-3c61a4bd6285 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:42.525823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:42.625868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f0770-e66f-411a-a063-3c61a4bd6285 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:42.628319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d426b6d-3f61-4ba4-9ea4-e60eb030bf49 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:42.666445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:42.667979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.668572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.668924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f7d3f-8667-4228-9b1c-7e500efe66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:42.669259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.669711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f7d3f-8667-4228-9b1c-7e500efe66ad None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.669989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f7d3f-8667-4228-9b1c-7e500efe66ad None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.670259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f7d3f-8667-4228-9b1c-7e500efe66ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.670883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:42.672780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:42.674470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING keystone.server.flask.common [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 03 16:14:42.684786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f7d3f-8667-4228-9b1c-7e500efe66ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:42.686174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f7d3f-8667-4228-9b1c-7e500efe66ad None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:42.695971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.sql.core [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 16:14:42.695971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 16:14:42.695971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [parameters: {'id': 'ddca22e355e94b3e9b55f8aa492d9040', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 16:14:42.695971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80222) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ddca22e355e94b3e9b55f8aa492d9040.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ddca22e355e94b3e9b55f8aa492d9040. Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application conn.query(q) Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 16:14:42.703486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application result.read() Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 03 16:14:42.704400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application next(self.gen) Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application yield resource Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application next(self.gen) Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise self.value Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application session.commit() Jun 03 16:14:42.705428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.session.flush() Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application compat.raise_( Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 16:14:42.706916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 16:14:42.707975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application conn.query(q) Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application result.read() Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 16:14:42.708811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [parameters: {'id': 'ddca22e355e94b3e9b55f8aa492d9040', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:42.711227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:42.713476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:42.717194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:42.717194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 03 16:14:42.717194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 03 16:14:42.717194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:42.717194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:42.717194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 03 16:14:42.717194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 03 16:14:42.717194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ddca22e355e94b3e9b55f8aa492d9040. Jun 03 16:14:42.717194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-177f7d3f-8667-4228-9b1c-7e500efe66ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:42.718728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:42.722004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:42.724367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:42.724367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:42.724367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:42.724367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:42.725126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 482/963] 10.222.0.112 () {60 vars in 1145 bytes} [Fri Jun 3 16:14:42 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:42.725126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:42.725386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 482/964] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:42.725386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f7d3f-8667-4228-9b1c-7e500efe66ad None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:42.766171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:42.781959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:42.827610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aad93-f647-45c0-97f2-4e5b7be42e54 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:42.832392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f7d3f-8667-4228-9b1c-7e500efe66ad None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:42.869492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e026b-5e1a-4946-8e97-e9e461178c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:42.870516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e026b-5e1a-4946-8e97-e9e461178c95 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.870898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e026b-5e1a-4946-8e97-e9e461178c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.871240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e026b-5e1a-4946-8e97-e9e461178c95 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.872012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e026b-5e1a-4946-8e97-e9e461178c95 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:42.872144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabddd6-8f1b-4104-b1a0-9b16fd936d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:42.872976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabddd6-8f1b-4104-b1a0-9b16fd936d29 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:42.873333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabddd6-8f1b-4104-b1a0-9b16fd936d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:42.873682 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabddd6-8f1b-4104-b1a0-9b16fd936d29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:42.873885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e026b-5e1a-4946-8e97-e9e461178c95 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:42.881383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabddd6-8f1b-4104-b1a0-9b16fd936d29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:42.883067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabddd6-8f1b-4104-b1a0-9b16fd936d29 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ce8e026b-5e1a-4946-8e97-e9e461178c95 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:42.886561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:42.888087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:42.889256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 483/965] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:42.890260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e026b-5e1a-4946-8e97-e9e461178c95 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-aeabddd6-8f1b-4104-b1a0-9b16fd936d29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:42.904757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:42.905889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:42.906993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:42.906993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:42.906993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:42.906993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:42.906993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:42.906993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:42.906993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:42.906993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:42.907871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 483/966] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:42.908714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabddd6-8f1b-4104-b1a0-9b16fd936d29 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:43.009579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e026b-5e1a-4946-8e97-e9e461178c95 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:43.022444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabddd6-8f1b-4104-b1a0-9b16fd936d29 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:43.023979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:43.041349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:43.049811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26d10f-1d5e-4bb8-86a1-d5ba3e072982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:43.050578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26d10f-1d5e-4bb8-86a1-d5ba3e072982 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:43.050996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26d10f-1d5e-4bb8-86a1-d5ba3e072982 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:43.051276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26d10f-1d5e-4bb8-86a1-d5ba3e072982 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:43.052172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26d10f-1d5e-4bb8-86a1-d5ba3e072982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:43.052488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26d10f-1d5e-4bb8-86a1-d5ba3e072982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:43.054038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26d10f-1d5e-4bb8-86a1-d5ba3e072982 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:43.062378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d689b-a7be-4f07-a545-885c9d91f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:43.063215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d689b-a7be-4f07-a545-885c9d91f50c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:43.063643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d689b-a7be-4f07-a545-885c9d91f50c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:43.064013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d689b-a7be-4f07-a545-885c9d91f50c None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:43.064819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d689b-a7be-4f07-a545-885c9d91f50c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:43.065129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d689b-a7be-4f07-a545-885c9d91f50c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:43.066606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d689b-a7be-4f07-a545-885c9d91f50c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:43.070879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 484/967] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:43.071541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26d10f-1d5e-4bb8-86a1-d5ba3e072982 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:43.080685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 484/968] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:42 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:43.080685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d689b-a7be-4f07-a545-885c9d91f50c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:43.186099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26d10f-1d5e-4bb8-86a1-d5ba3e072982 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:43.200387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d689b-a7be-4f07-a545-885c9d91f50c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:43.228113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762500f2-8b38-4b05-bfb4-d88b17e44216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:43.228790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762500f2-8b38-4b05-bfb4-d88b17e44216 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:43.229077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762500f2-8b38-4b05-bfb4-d88b17e44216 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:43.229358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762500f2-8b38-4b05-bfb4-d88b17e44216 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:43.230685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762500f2-8b38-4b05-bfb4-d88b17e44216 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:43.231000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762500f2-8b38-4b05-bfb4-d88b17e44216 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:43.232726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762500f2-8b38-4b05-bfb4-d88b17e44216 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:43.238404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3be86-7fd4-4c52-8554-5157e896f40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:43.239402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3be86-7fd4-4c52-8554-5157e896f40b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:43.239850 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3be86-7fd4-4c52-8554-5157e896f40b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:43.240266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3be86-7fd4-4c52-8554-5157e896f40b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:43.248419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3be86-7fd4-4c52-8554-5157e896f40b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:43.249861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3be86-7fd4-4c52-8554-5157e896f40b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:43.259673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 485/969] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:43 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:43.259673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762500f2-8b38-4b05-bfb4-d88b17e44216 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5eb3be86-7fd4-4c52-8554-5157e896f40b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:43.274725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:43.275793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:43.276777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:43.276777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:43.276777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:43.276777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:43.276777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:43.276777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:43.276777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:43.276777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:43.276777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 485/970] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:43.282361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3be86-7fd4-4c52-8554-5157e896f40b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:43.299133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:43.345014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:43.412106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762500f2-8b38-4b05-bfb4-d88b17e44216 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:43.438301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3be86-7fd4-4c52-8554-5157e896f40b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:43.456513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67385bc1-921d-4a75-811b-281e7dfc7d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:43.457258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67385bc1-921d-4a75-811b-281e7dfc7d9a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:43.457648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67385bc1-921d-4a75-811b-281e7dfc7d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:43.458059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67385bc1-921d-4a75-811b-281e7dfc7d9a None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:43.459000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67385bc1-921d-4a75-811b-281e7dfc7d9a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:43.459444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67385bc1-921d-4a75-811b-281e7dfc7d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:43.461062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67385bc1-921d-4a75-811b-281e7dfc7d9a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:43.471947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 486/971] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:43 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:43.472975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67385bc1-921d-4a75-811b-281e7dfc7d9a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:43.489549 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda27a6-955a-4e11-a655-650bc7391fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:43.490456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda27a6-955a-4e11-a655-650bc7391fcf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:43.490739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda27a6-955a-4e11-a655-650bc7391fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:43.491504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda27a6-955a-4e11-a655-650bc7391fcf None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:43.492519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda27a6-955a-4e11-a655-650bc7391fcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:43.492953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda27a6-955a-4e11-a655-650bc7391fcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:43.494738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda27a6-955a-4e11-a655-650bc7391fcf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:43.512805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 486/972] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:43.519620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda27a6-955a-4e11-a655-650bc7391fcf None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:43.590306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:43.597599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67385bc1-921d-4a75-811b-281e7dfc7d9a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:43.633435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:43.637584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda27a6-955a-4e11-a655-650bc7391fcf None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:43.652506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8e2b5-96c0-4fa5-b9a5-ce4a5e8003d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:43.653202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e2b5-96c0-4fa5-b9a5-ce4a5e8003d6 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:43.653733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e2b5-96c0-4fa5-b9a5-ce4a5e8003d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:43.654013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e2b5-96c0-4fa5-b9a5-ce4a5e8003d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:43.655256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8e2b5-96c0-4fa5-b9a5-ce4a5e8003d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:43.656951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8e2b5-96c0-4fa5-b9a5-ce4a5e8003d6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:43.677133 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b9a98-1ede-4145-9135-3b77bd883312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:43.677998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b9a98-1ede-4145-9135-3b77bd883312 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:43.678374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b9a98-1ede-4145-9135-3b77bd883312 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:43.678816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b9a98-1ede-4145-9135-3b77bd883312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:43.679894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b9a98-1ede-4145-9135-3b77bd883312 None admin] RBAC: Adding query filter params (role.id=cac2df5a53594fd4823118be07082990, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=9b44182e2e5b4b34bd549452c305c194) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:43.680302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b9a98-1ede-4145-9135-3b77bd883312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:43.681883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b9a98-1ede-4145-9135-3b77bd883312 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:43.683297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 487/973] 10.222.0.112 () {60 vars in 1149 bytes} [Fri Jun 3 16:14:43 2022] POST /identity/v3/endpoints => generated 351 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:43.693683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 487/974] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:43 2022] GET /identity/v3/role_assignments?user.id=9b44182e2e5b4b34bd549452c305c194&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=cac2df5a53594fd4823118be07082990 => generated 610 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:44.613308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1826b-3570-432a-accb-4aa2f2998eb7 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:44.613809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1826b-3570-432a-accb-4aa2f2998eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:44.613809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1826b-3570-432a-accb-4aa2f2998eb7 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:44.615479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 488/975] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:44.621664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9d500-1abd-49df-a6e2-44eda95822ca None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:44.622202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9d500-1abd-49df-a6e2-44eda95822ca None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:44.622202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9d500-1abd-49df-a6e2-44eda95822ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:44.639690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-82e9d500-1abd-49df-a6e2-44eda95822ca None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:44.640906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-82e9d500-1abd-49df-a6e2-44eda95822ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:44.720126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 488/976] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:44 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:44.742868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1826b-3570-432a-accb-4aa2f2998eb7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:44.846809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1826b-3570-432a-accb-4aa2f2998eb7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:44.884806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930543c-7d31-485b-b4c6-d400a980a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:44.885489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930543c-7d31-485b-b4c6-d400a980a55a None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:44.885811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930543c-7d31-485b-b4c6-d400a980a55a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:44.886086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930543c-7d31-485b-b4c6-d400a980a55a None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:44.886827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930543c-7d31-485b-b4c6-d400a980a55a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:44.888285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930543c-7d31-485b-b4c6-d400a980a55a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:44.907633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 489/977] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:14:44 2022] POST /identity/v3/services => generated 243 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:45.728533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713120f-d161-4ae9-afe8-de7969501902 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:45.729740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713120f-d161-4ae9-afe8-de7969501902 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:45.730271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713120f-d161-4ae9-afe8-de7969501902 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:45.732691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 489/978] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:45 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:45.738947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd876f1-4030-4544-a4c7-ae6be07c84d6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:45.739964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd876f1-4030-4544-a4c7-ae6be07c84d6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:45.740451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd876f1-4030-4544-a4c7-ae6be07c84d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:45.758655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7cd876f1-4030-4544-a4c7-ae6be07c84d6 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:45.760594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7cd876f1-4030-4544-a4c7-ae6be07c84d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:45.769582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:45.851329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 490/979] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:45 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:45.877024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713120f-d161-4ae9-afe8-de7969501902 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:45.975905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:45.988174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713120f-d161-4ae9-afe8-de7969501902 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:46.023913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b812365-5699-478a-a52a-3c35a0634e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:46.024589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b812365-5699-478a-a52a-3c35a0634e3c None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.024870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b812365-5699-478a-a52a-3c35a0634e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.025142 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b812365-5699-478a-a52a-3c35a0634e3c None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.025856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b812365-5699-478a-a52a-3c35a0634e3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:46.027440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b812365-5699-478a-a52a-3c35a0634e3c None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:46.028837 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WARNING keystone.server.flask.common [None req-1b812365-5699-478a-a52a-3c35a0634e3c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 03 16:14:46.042913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.sql.core [None req-1b812365-5699-478a-a52a-3c35a0634e3c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 16:14:46.042913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 16:14:46.042913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [parameters: {'user_id': '8baf338e06e04e6e8d079fe251c49983', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 16:14:46.042913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80221) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-1b812365-5699-478a-a52a-3c35a0634e3c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application conn.query(q) Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application result.read() Jun 03 16:14:46.060603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 16:14:46.061605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application next(self.gen) Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application yield resource Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application next(self.gen) Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise self.value Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application session.commit() Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 16:14:46.062576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.session.flush() Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application compat.raise_( Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 16:14:46.063480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 16:14:46.064435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application conn.query(q) Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application result.read() Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 16:14:46.065299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [parameters: {'user_id': '8baf338e06e04e6e8d079fe251c49983', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:46.066145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 03 16:14:46.066968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 03 16:14:46.069632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 03 16:14:46.069632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 03 16:14:46.069632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 16:14:46.069632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 16:14:46.069632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 16:14:46.069632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:46.069632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 490/980] 10.222.0.112 () {60 vars in 1136 bytes} [Fri Jun 3 16:14:45 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:46.070492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd876f1-4030-4544-a4c7-ae6be07c84d6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:46.102592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088169-2e65-4bb7-b15b-9ff530579bd7 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.102909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088169-2e65-4bb7-b15b-9ff530579bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.103144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088169-2e65-4bb7-b15b-9ff530579bd7 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.112608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 491/981] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:46 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:46.114316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461804b1-420b-4f0c-ab94-73162cfe7e18 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.114604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461804b1-420b-4f0c-ab94-73162cfe7e18 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.114883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461804b1-420b-4f0c-ab94-73162cfe7e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.139054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-461804b1-420b-4f0c-ab94-73162cfe7e18 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:46.140605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-461804b1-420b-4f0c-ab94-73162cfe7e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:46.182239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd876f1-4030-4544-a4c7-ae6be07c84d6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:46.218473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65973ec1-e9ad-4d96-a594-0a74ee0cfbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:46.219317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65973ec1-e9ad-4d96-a594-0a74ee0cfbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.219699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65973ec1-e9ad-4d96-a594-0a74ee0cfbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.219983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65973ec1-e9ad-4d96-a594-0a74ee0cfbf6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.229199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65973ec1-e9ad-4d96-a594-0a74ee0cfbf6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:46.231515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65973ec1-e9ad-4d96-a594-0a74ee0cfbf6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:46.233541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:46.236044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 492/982] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:46 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:46.238467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3016-04ed-4fe6-a1e9-fc753e0f734d None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.238929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3016-04ed-4fe6-a1e9-fc753e0f734d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.239379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3016-04ed-4fe6-a1e9-fc753e0f734d None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.240904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 493/983] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:46.249328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f0b21-7bab-440f-9d10-3ab0fd52ca9e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.249797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f0b21-7bab-440f-9d10-3ab0fd52ca9e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.250247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f0b21-7bab-440f-9d10-3ab0fd52ca9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-65973ec1-e9ad-4d96-a594-0a74ee0cfbf6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:46.251200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:46.252403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 16:14:46.253664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:46.254938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 491/984] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:46.255771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65973ec1-e9ad-4d96-a594-0a74ee0cfbf6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:46.273862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-742f0b21-7bab-440f-9d10-3ab0fd52ca9e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:46.275067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-742f0b21-7bab-440f-9d10-3ab0fd52ca9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:46.351027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 494/985] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:46 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:46.352256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f0b21-7bab-440f-9d10-3ab0fd52ca9e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:46.375804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:46.378579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65973ec1-e9ad-4d96-a594-0a74ee0cfbf6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:46.418246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702b4a0-51bc-4858-bb59-8e190ebd6b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:46.419186 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702b4a0-51bc-4858-bb59-8e190ebd6b99 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.419475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702b4a0-51bc-4858-bb59-8e190ebd6b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.419837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702b4a0-51bc-4858-bb59-8e190ebd6b99 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.420503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702b4a0-51bc-4858-bb59-8e190ebd6b99 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:46.421896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702b4a0-51bc-4858-bb59-8e190ebd6b99 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a702b4a0-51bc-4858-bb59-8e190ebd6b99 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:46.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:46.435907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:46.436784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 492/986] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:46.437645 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702b4a0-51bc-4858-bb59-8e190ebd6b99 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:46.478263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f0b21-7bab-440f-9d10-3ab0fd52ca9e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:46.504587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:46.516775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83109a7-a4ac-4ca5-96c4-f53c5f9f766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:46.517450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83109a7-a4ac-4ca5-96c4-f53c5f9f766f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.517737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83109a7-a4ac-4ca5-96c4-f53c5f9f766f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.518015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83109a7-a4ac-4ca5-96c4-f53c5f9f766f None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.518846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83109a7-a4ac-4ca5-96c4-f53c5f9f766f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:46.519154 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83109a7-a4ac-4ca5-96c4-f53c5f9f766f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:46.520750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83109a7-a4ac-4ca5-96c4-f53c5f9f766f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:46.551001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702b4a0-51bc-4858-bb59-8e190ebd6b99 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:46.558818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 495/987] 10.222.0.112 () {56 vars in 1106 bytes} [Fri Jun 3 16:14:46 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:46.560001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83109a7-a4ac-4ca5-96c4-f53c5f9f766f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:46.598890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a6be4-0754-4394-a3af-029b3e2f1a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:46.599845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a6be4-0754-4394-a3af-029b3e2f1a6b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.600131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a6be4-0754-4394-a3af-029b3e2f1a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.600413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a6be4-0754-4394-a3af-029b3e2f1a6b None admin] PATH_INFO: `/v3/services/image` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.601085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a6be4-0754-4394-a3af-029b3e2f1a6b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:46.602648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a6be4-0754-4394-a3af-029b3e2f1a6b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f53a6be4-0754-4394-a3af-029b3e2f1a6b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:46.616303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:46.617662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 16:14:46.618750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:46.623353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 493/988] 10.222.0.112 () {56 vars in 1110 bytes} [Fri Jun 3 16:14:46 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:46.624656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a6be4-0754-4394-a3af-029b3e2f1a6b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:46.659224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:46.702502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83109a7-a4ac-4ca5-96c4-f53c5f9f766f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:46.752319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e3d6a-fcdc-472d-bec3-bc7e8df9ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:46.752985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a6be4-0754-4394-a3af-029b3e2f1a6b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:46.754093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e3d6a-fcdc-472d-bec3-bc7e8df9ac96 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.754830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e3d6a-fcdc-472d-bec3-bc7e8df9ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.756223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e3d6a-fcdc-472d-bec3-bc7e8df9ac96 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.757135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e3d6a-fcdc-472d-bec3-bc7e8df9ac96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:46.757603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e3d6a-fcdc-472d-bec3-bc7e8df9ac96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:46.759188 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e3d6a-fcdc-472d-bec3-bc7e8df9ac96 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:46.767100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 496/989] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:46 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:46.772863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e3d6a-fcdc-472d-bec3-bc7e8df9ac96 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:46.785566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:46.797219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95ea91-6185-48da-a7d6-5c00c1abcf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:46.798461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95ea91-6185-48da-a7d6-5c00c1abcf53 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.798901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95ea91-6185-48da-a7d6-5c00c1abcf53 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.799362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95ea91-6185-48da-a7d6-5c00c1abcf53 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.800337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95ea91-6185-48da-a7d6-5c00c1abcf53 None admin] RBAC: Adding query filter params (name=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:46.801241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95ea91-6185-48da-a7d6-5c00c1abcf53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:46.802816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95ea91-6185-48da-a7d6-5c00c1abcf53 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:46.810500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 494/990] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:46 2022] GET /identity/v3/services?name=image => generated 123 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:46.817858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95ea91-6185-48da-a7d6-5c00c1abcf53 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:46.905406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e3d6a-fcdc-472d-bec3-bc7e8df9ac96 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:46.948055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec70a8-85e0-452e-8158-342a5e6ca9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:46.948630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95ea91-6185-48da-a7d6-5c00c1abcf53 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:46.949342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec70a8-85e0-452e-8158-342a5e6ca9ff None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.949852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec70a8-85e0-452e-8158-342a5e6ca9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.950392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec70a8-85e0-452e-8158-342a5e6ca9ff None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.951444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec70a8-85e0-452e-8158-342a5e6ca9ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:46.951848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec70a8-85e0-452e-8158-342a5e6ca9ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:46.953255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec70a8-85e0-452e-8158-342a5e6ca9ff None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:46.954655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:46.964636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 497/991] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:46 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:46.965798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec70a8-85e0-452e-8158-342a5e6ca9ff None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:46.984866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356e399-821a-46af-8f47-f64892ee0da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:46.985533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356e399-821a-46af-8f47-f64892ee0da1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:46.985821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356e399-821a-46af-8f47-f64892ee0da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:46.986101 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356e399-821a-46af-8f47-f64892ee0da1 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:46.986816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356e399-821a-46af-8f47-f64892ee0da1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:46.987126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356e399-821a-46af-8f47-f64892ee0da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:46.988549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356e399-821a-46af-8f47-f64892ee0da1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:47.003587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 495/992] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:46 2022] GET /identity/v3/services?type=image => generated 123 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:47.090200 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec70a8-85e0-452e-8158-342a5e6ca9ff None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:47.129526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb408f-02e8-478f-a0bf-5776bb41515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:47.130231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb408f-02e8-478f-a0bf-5776bb41515e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:47.130516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb408f-02e8-478f-a0bf-5776bb41515e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:47.130793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb408f-02e8-478f-a0bf-5776bb41515e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:47.131677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb408f-02e8-478f-a0bf-5776bb41515e None admin] RBAC: Adding query filter params (interface=admin, service_id=9fe6c09b4d0b4892bc9e5b8f11764a47, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:47.132006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb408f-02e8-478f-a0bf-5776bb41515e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:47.133559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb408f-02e8-478f-a0bf-5776bb41515e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:47.139978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 498/993] 10.222.0.112 () {56 vars in 1254 bytes} [Fri Jun 3 16:14:46 2022] GET /identity/v3/endpoints?service_id=9fe6c09b4d0b4892bc9e5b8f11764a47&interface=admin®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:47.146238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356e399-821a-46af-8f47-f64892ee0da1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:47.210603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:47.259469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356e399-821a-46af-8f47-f64892ee0da1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:47.294529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce36ec-a498-4c09-93fc-d327b1bbfa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:47.295195 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce36ec-a498-4c09-93fc-d327b1bbfa76 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:47.295477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce36ec-a498-4c09-93fc-d327b1bbfa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:47.295781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce36ec-a498-4c09-93fc-d327b1bbfa76 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:47.296470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce36ec-a498-4c09-93fc-d327b1bbfa76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:47.297836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce36ec-a498-4c09-93fc-d327b1bbfa76 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:47.304242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 496/994] 10.222.0.112 () {56 vars in 1092 bytes} [Fri Jun 3 16:14:47 2022] GET /identity/v3/services => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:14:47.473148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391d05b-d46a-4c7d-b460-32ffc100d831 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:47.473537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391d05b-d46a-4c7d-b460-32ffc100d831 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:47.473720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391d05b-d46a-4c7d-b460-32ffc100d831 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:47.475114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 499/995] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:47.481930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72db9e6-8e5e-46b7-93d6-cd6632ce53c1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:47.482308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72db9e6-8e5e-46b7-93d6-cd6632ce53c1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:47.482484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72db9e6-8e5e-46b7-93d6-cd6632ce53c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:47.499969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a72db9e6-8e5e-46b7-93d6-cd6632ce53c1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:47.501149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a72db9e6-8e5e-46b7-93d6-cd6632ce53c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:47.573649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 497/996] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:47 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:47.596039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391d05b-d46a-4c7d-b460-32ffc100d831 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:47.664637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:47.709520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391d05b-d46a-4c7d-b460-32ffc100d831 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:47.746051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f46c0-40e6-4382-964f-36c7cdeb7c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:47.746769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f46c0-40e6-4382-964f-36c7cdeb7c4b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:47.747052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f46c0-40e6-4382-964f-36c7cdeb7c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:47.747329 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f46c0-40e6-4382-964f-36c7cdeb7c4b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:47.748056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f46c0-40e6-4382-964f-36c7cdeb7c4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:47.749494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f46c0-40e6-4382-964f-36c7cdeb7c4b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c84f46c0-40e6-4382-964f-36c7cdeb7c4b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:47.762314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:47.769213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:47.770290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 500/997] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:47.772757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72db9e6-8e5e-46b7-93d6-cd6632ce53c1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:47.824286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:47.877621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72db9e6-8e5e-46b7-93d6-cd6632ce53c1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:47.912650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922c44b-d547-461b-906f-1b22690d6bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:47.913305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922c44b-d547-461b-906f-1b22690d6bfb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:47.913583 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922c44b-d547-461b-906f-1b22690d6bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:47.913850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922c44b-d547-461b-906f-1b22690d6bfb None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:47.914578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922c44b-d547-461b-906f-1b22690d6bfb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:47.914922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922c44b-d547-461b-906f-1b22690d6bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:47.916317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922c44b-d547-461b-906f-1b22690d6bfb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:47.921956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 498/998] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:47 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:47.927516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f46c0-40e6-4382-964f-36c7cdeb7c4b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:48.032536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f46c0-40e6-4382-964f-36c7cdeb7c4b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:48.059470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:48.068864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e64e7-650d-496c-b093-944cf6c4be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:48.069537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e64e7-650d-496c-b093-944cf6c4be77 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:48.069822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e64e7-650d-496c-b093-944cf6c4be77 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:48.070100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e64e7-650d-496c-b093-944cf6c4be77 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:48.070811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e64e7-650d-496c-b093-944cf6c4be77 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:48.071120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e64e7-650d-496c-b093-944cf6c4be77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:48.072531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e64e7-650d-496c-b093-944cf6c4be77 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:48.078742 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 501/999] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:47 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:48.084343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922c44b-d547-461b-906f-1b22690d6bfb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:48.197299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922c44b-d547-461b-906f-1b22690d6bfb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:48.211519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:48.235765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3da3e-de5d-4620-a9b5-6776382029bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:48.236438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3da3e-de5d-4620-a9b5-6776382029bf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:48.236721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3da3e-de5d-4620-a9b5-6776382029bf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:48.236995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3da3e-de5d-4620-a9b5-6776382029bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:48.237792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3da3e-de5d-4620-a9b5-6776382029bf None admin] RBAC: Adding query filter params (interface=public, service_id=6e6186fadd4a4e55a76b77699f70acf7, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:48.238104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3da3e-de5d-4620-a9b5-6776382029bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:48.239480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3da3e-de5d-4620-a9b5-6776382029bf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:48.250265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 499/1000] 10.222.0.112 () {56 vars in 1256 bytes} [Fri Jun 3 16:14:48 2022] GET /identity/v3/endpoints?service_id=6e6186fadd4a4e55a76b77699f70acf7&interface=public®ion_id=RegionOne => generated 195 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:48.251097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e64e7-650d-496c-b093-944cf6c4be77 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:48.353978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e64e7-650d-496c-b093-944cf6c4be77 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:48.389092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3296e7-bcae-49be-b681-3aff63af7b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:48.389804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3296e7-bcae-49be-b681-3aff63af7b69 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:48.390093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3296e7-bcae-49be-b681-3aff63af7b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:48.390371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3296e7-bcae-49be-b681-3aff63af7b69 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:48.391049 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3296e7-bcae-49be-b681-3aff63af7b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:48.392449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3296e7-bcae-49be-b681-3aff63af7b69 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:48.407647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 502/1001] 10.222.0.112 () {56 vars in 1092 bytes} [Fri Jun 3 16:14:48 2022] GET /identity/v3/services => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:14:49.302396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f90fd4-a3a3-4092-b1e0-5aa0380202d8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:49.302918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f90fd4-a3a3-4092-b1e0-5aa0380202d8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:49.303006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f90fd4-a3a3-4092-b1e0-5aa0380202d8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:49.304482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 500/1002] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:49.309474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c7b1e-c9e1-4ea0-878b-3c4edab4fffa None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:49.309888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c7b1e-c9e1-4ea0-878b-3c4edab4fffa None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:49.310069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c7b1e-c9e1-4ea0-878b-3c4edab4fffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:49.327172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-269c7b1e-c9e1-4ea0-878b-3c4edab4fffa None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:49.328373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-269c7b1e-c9e1-4ea0-878b-3c4edab4fffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:49.384964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:49.406082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 503/1003] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:49 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:49.428765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f90fd4-a3a3-4092-b1e0-5aa0380202d8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:49.533869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f90fd4-a3a3-4092-b1e0-5aa0380202d8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:49.569617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39932fb-6ecd-4f53-9f47-d0beaca97b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:49.570305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39932fb-6ecd-4f53-9f47-d0beaca97b64 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:49.570588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39932fb-6ecd-4f53-9f47-d0beaca97b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:49.570860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39932fb-6ecd-4f53-9f47-d0beaca97b64 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:49.571612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39932fb-6ecd-4f53-9f47-d0beaca97b64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:49.573604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39932fb-6ecd-4f53-9f47-d0beaca97b64 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:49.582029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e8216-2826-4111-9f59-2ed1a3b71c82 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:49.582304 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e8216-2826-4111-9f59-2ed1a3b71c82 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:49.582537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e8216-2826-4111-9f59-2ed1a3b71c82 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:49.584069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 504/1004] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:49.588257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 501/1005] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:14:49 2022] POST /identity/v3/services => generated 243 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:14:49.589589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8696-6d2b-4073-bca8-92ecaec12dc9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:49.589879 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8696-6d2b-4073-bca8-92ecaec12dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:49.590158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8696-6d2b-4073-bca8-92ecaec12dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:49.609136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5e0f8696-6d2b-4073-bca8-92ecaec12dc9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:49.610716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5e0f8696-6d2b-4073-bca8-92ecaec12dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:49.693504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 505/1006] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:49 2022] POST /identity/v3/auth/tokens => generated 1658 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:49.717235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39932fb-6ecd-4f53-9f47-d0beaca97b64 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:49.758858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:49.830931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39932fb-6ecd-4f53-9f47-d0beaca97b64 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:49.867131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b36565-5d57-4d76-ae71-5a643bdd576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:49.867966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36565-5d57-4d76-ae71-5a643bdd576b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:49.868254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36565-5d57-4d76-ae71-5a643bdd576b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:49.868533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36565-5d57-4d76-ae71-5a643bdd576b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:49.869191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b36565-5d57-4d76-ae71-5a643bdd576b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:49.871183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b36565-5d57-4d76-ae71-5a643bdd576b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e7b36565-5d57-4d76-ae71-5a643bdd576b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:49.883318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:49.884536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:49.885400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 502/1007] 10.222.0.112 () {56 vars in 1131 bytes} [Fri Jun 3 16:14:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:49.890654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f8696-6d2b-4073-bca8-92ecaec12dc9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:49.998929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f8696-6d2b-4073-bca8-92ecaec12dc9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:50.010396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:50.036989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba46fc7-846f-4da8-84bc-2e5def860a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:50.037381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba46fc7-846f-4da8-84bc-2e5def860a12 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:50.037688 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba46fc7-846f-4da8-84bc-2e5def860a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:50.037829 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba46fc7-846f-4da8-84bc-2e5def860a12 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:50.038547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba46fc7-846f-4da8-84bc-2e5def860a12 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:50.039034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba46fc7-846f-4da8-84bc-2e5def860a12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:50.040283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba46fc7-846f-4da8-84bc-2e5def860a12 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:50.051237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 506/1008] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:49 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:50.052807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b36565-5d57-4d76-ae71-5a643bdd576b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:50.156362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:50.162607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b36565-5d57-4d76-ae71-5a643bdd576b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:50.199970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7421ad-f0c6-43e7-8114-f49c73ba3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:50.200633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7421ad-f0c6-43e7-8114-f49c73ba3850 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:50.200916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7421ad-f0c6-43e7-8114-f49c73ba3850 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:50.201192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7421ad-f0c6-43e7-8114-f49c73ba3850 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:50.201902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7421ad-f0c6-43e7-8114-f49c73ba3850 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:50.202207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7421ad-f0c6-43e7-8114-f49c73ba3850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:50.203639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7421ad-f0c6-43e7-8114-f49c73ba3850 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:50.208943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 503/1009] 10.222.0.112 () {56 vars in 1127 bytes} [Fri Jun 3 16:14:50 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:50.214638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba46fc7-846f-4da8-84bc-2e5def860a12 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:50.321219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba46fc7-846f-4da8-84bc-2e5def860a12 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:50.358666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431bd63-c2c9-49c1-8f00-fdca45fcc6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:50.359348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431bd63-c2c9-49c1-8f00-fdca45fcc6d6 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:50.359665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431bd63-c2c9-49c1-8f00-fdca45fcc6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:50.359944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431bd63-c2c9-49c1-8f00-fdca45fcc6d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:50.360717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431bd63-c2c9-49c1-8f00-fdca45fcc6d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:50.362169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431bd63-c2c9-49c1-8f00-fdca45fcc6d6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:50.387597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 507/1010] 10.222.0.112 () {60 vars in 1149 bytes} [Fri Jun 3 16:14:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:50.692708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee026b4-ac90-4361-953d-c6bd92a93f7b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:50.693371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee026b4-ac90-4361-953d-c6bd92a93f7b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:50.693371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee026b4-ac90-4361-953d-c6bd92a93f7b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:50.694613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 504/1011] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:50.700619 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c73b0-d582-467b-a419-d7f2f910d7aa None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:50.700914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c73b0-d582-467b-a419-d7f2f910d7aa None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:50.701192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c73b0-d582-467b-a419-d7f2f910d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:50.719124 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-064c73b0-d582-467b-a419-d7f2f910d7aa None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:50.720389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-064c73b0-d582-467b-a419-d7f2f910d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:50.748711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:50.803594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 508/1012] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:50 2022] POST /identity/v3/auth/tokens => generated 1806 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:50.824543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee026b4-ac90-4361-953d-c6bd92a93f7b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:50.933247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee026b4-ac90-4361-953d-c6bd92a93f7b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:50.968690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75799f-9a61-472d-b9c7-252708beaf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:50.969395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75799f-9a61-472d-b9c7-252708beaf7b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:50.969690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75799f-9a61-472d-b9c7-252708beaf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:50.969956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75799f-9a61-472d-b9c7-252708beaf7b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:50.970600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75799f-9a61-472d-b9c7-252708beaf7b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:50.972027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75799f-9a61-472d-b9c7-252708beaf7b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-dd75799f-9a61-472d-b9c7-252708beaf7b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:50.984160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:50.985173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:50.986061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 505/1013] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:50.991894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c73b0-d582-467b-a419-d7f2f910d7aa None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:51.091772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c73b0-d582-467b-a419-d7f2f910d7aa None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:51.126237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf2ede-8e9b-48fc-b0fa-6c5ad977b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:51.126904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf2ede-8e9b-48fc-b0fa-6c5ad977b3dd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:51.127182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf2ede-8e9b-48fc-b0fa-6c5ad977b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:51.127455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf2ede-8e9b-48fc-b0fa-6c5ad977b3dd None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:51.128192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf2ede-8e9b-48fc-b0fa-6c5ad977b3dd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:51.128496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf2ede-8e9b-48fc-b0fa-6c5ad977b3dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:51.130132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf2ede-8e9b-48fc-b0fa-6c5ad977b3dd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:51.135498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 509/1014] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:50 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:51.141778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75799f-9a61-472d-b9c7-252708beaf7b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:51.179960 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:51.255225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75799f-9a61-472d-b9c7-252708beaf7b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:51.289129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f04cb-3cac-4717-92ad-9b8251a56c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:51.289788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f04cb-3cac-4717-92ad-9b8251a56c31 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:51.290068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f04cb-3cac-4717-92ad-9b8251a56c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:51.290339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f04cb-3cac-4717-92ad-9b8251a56c31 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:51.291038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f04cb-3cac-4717-92ad-9b8251a56c31 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:51.291342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f04cb-3cac-4717-92ad-9b8251a56c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:51.293299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f04cb-3cac-4717-92ad-9b8251a56c31 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:51.298459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 506/1015] 10.222.0.112 () {56 vars in 1117 bytes} [Fri Jun 3 16:14:51 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:51.303930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf2ede-8e9b-48fc-b0fa-6c5ad977b3dd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:51.328645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:51.406278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf2ede-8e9b-48fc-b0fa-6c5ad977b3dd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:51.440889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5e6d5-7909-4c50-b4ae-f9f2d46672d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:51.441545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5e6d5-7909-4c50-b4ae-f9f2d46672d5 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:51.441846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5e6d5-7909-4c50-b4ae-f9f2d46672d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:51.442123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5e6d5-7909-4c50-b4ae-f9f2d46672d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:51.442870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5e6d5-7909-4c50-b4ae-f9f2d46672d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:51.444261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5e6d5-7909-4c50-b4ae-f9f2d46672d5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:51.471716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 510/1016] 10.222.0.112 () {60 vars in 1149 bytes} [Fri Jun 3 16:14:51 2022] POST /identity/v3/endpoints => generated 336 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:51.932202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad76cea-31f0-475b-b204-6c4d08f05508 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:51.932726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad76cea-31f0-475b-b204-6c4d08f05508 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:51.932726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad76cea-31f0-475b-b204-6c4d08f05508 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:51.934117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 507/1017] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:51.939821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6a06-0818-42eb-8a8b-e03feae4b16a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:51.940115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6a06-0818-42eb-8a8b-e03feae4b16a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:51.940396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa6a06-0818-42eb-8a8b-e03feae4b16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:51.957182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8caa6a06-0818-42eb-8a8b-e03feae4b16a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:51.958354 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8caa6a06-0818-42eb-8a8b-e03feae4b16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:52.032900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 511/1018] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:51 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:52.055970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad76cea-31f0-475b-b204-6c4d08f05508 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:52.162086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:52.178050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad76cea-31f0-475b-b204-6c4d08f05508 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:52.215368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ab8b-a4c8-41e7-af2e-ce089adf5770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:52.216104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ab8b-a4c8-41e7-af2e-ce089adf5770 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:52.216389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ab8b-a4c8-41e7-af2e-ce089adf5770 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:52.216664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ab8b-a4c8-41e7-af2e-ce089adf5770 None admin] PATH_INFO: `/v3/services/image` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:52.217325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ab8b-a4c8-41e7-af2e-ce089adf5770 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:52.218711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ab8b-a4c8-41e7-af2e-ce089adf5770 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7182ab8b-a4c8-41e7-af2e-ce089adf5770 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:52.231597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:52.232672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:52.233526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 508/1019] 10.222.0.112 () {56 vars in 1110 bytes} [Fri Jun 3 16:14:52 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:52.239009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa6a06-0818-42eb-8a8b-e03feae4b16a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:52.247653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:52.346562 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa6a06-0818-42eb-8a8b-e03feae4b16a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:52.383598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323b185-d142-4a79-8f74-e71570abcffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:52.384268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323b185-d142-4a79-8f74-e71570abcffd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:52.384551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323b185-d142-4a79-8f74-e71570abcffd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:52.384828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323b185-d142-4a79-8f74-e71570abcffd None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:52.386189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323b185-d142-4a79-8f74-e71570abcffd None admin] RBAC: Adding query filter params (name=image) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:52.386495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323b185-d142-4a79-8f74-e71570abcffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:52.387891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323b185-d142-4a79-8f74-e71570abcffd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:52.397409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 512/1020] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:52 2022] GET /identity/v3/services?name=image => generated 123 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:52.398953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ab8b-a4c8-41e7-af2e-ce089adf5770 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:52.501446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ab8b-a4c8-41e7-af2e-ce089adf5770 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:52.534365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ae913-8630-4211-97f3-6241160e7438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:52.535034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae913-8630-4211-97f3-6241160e7438 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:52.535315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae913-8630-4211-97f3-6241160e7438 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:52.535608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ae913-8630-4211-97f3-6241160e7438 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:52.536314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae913-8630-4211-97f3-6241160e7438 None admin] RBAC: Adding query filter params (type=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:52.536616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae913-8630-4211-97f3-6241160e7438 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:52.537973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ae913-8630-4211-97f3-6241160e7438 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:52.547612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 509/1021] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:52 2022] GET /identity/v3/services?type=image => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:52.549581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323b185-d142-4a79-8f74-e71570abcffd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:52.621390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:52.655223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323b185-d142-4a79-8f74-e71570abcffd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:52.662893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8dfee-df9c-4306-989d-92012b47dac5 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:52.663684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8dfee-df9c-4306-989d-92012b47dac5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:52.663973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8dfee-df9c-4306-989d-92012b47dac5 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:52.665729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 510/1022] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:52.671798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad86be-acac-417e-babd-a82409d05d1c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:52.672302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad86be-acac-417e-babd-a82409d05d1c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:52.672586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad86be-acac-417e-babd-a82409d05d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:52.690442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-acad86be-acac-417e-babd-a82409d05d1c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:52.691997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-acad86be-acac-417e-babd-a82409d05d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:52.692155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d7f80-9926-42e1-b694-c943a3ee9fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:52.692743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d7f80-9926-42e1-b694-c943a3ee9fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:52.693022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d7f80-9926-42e1-b694-c943a3ee9fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:52.693298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d7f80-9926-42e1-b694-c943a3ee9fd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:52.694113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d7f80-9926-42e1-b694-c943a3ee9fd2 None admin] RBAC: Adding query filter params (interface=public, service_id=339fd4ff55be4df0a5c9876faea685b7, region_id=RegionOne) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:52.694425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d7f80-9926-42e1-b694-c943a3ee9fd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:52.695882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d7f80-9926-42e1-b694-c943a3ee9fd2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:52.706382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 513/1023] 10.222.0.112 () {56 vars in 1256 bytes} [Fri Jun 3 16:14:52 2022] GET /identity/v3/endpoints?service_id=339fd4ff55be4df0a5c9876faea685b7&interface=public®ion_id=RegionOne => generated 195 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:52.707624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d7f80-9926-42e1-b694-c943a3ee9fd2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:52.708945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:52.769353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 511/1024] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:52 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:52.793472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad86be-acac-417e-babd-a82409d05d1c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:52.815163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d7f80-9926-42e1-b694-c943a3ee9fd2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:52.857426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227499f-8a3d-44ba-bbb7-914202cb2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:52.858075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227499f-8a3d-44ba-bbb7-914202cb2559 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:52.858359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227499f-8a3d-44ba-bbb7-914202cb2559 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:52.858658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227499f-8a3d-44ba-bbb7-914202cb2559 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:52.859454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227499f-8a3d-44ba-bbb7-914202cb2559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:52.860969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227499f-8a3d-44ba-bbb7-914202cb2559 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:52.862196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:52.878954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 514/1025] 10.222.0.112 () {56 vars in 1092 bytes} [Fri Jun 3 16:14:52 2022] GET /identity/v3/services => generated 1966 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:14:52.915752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad86be-acac-417e-babd-a82409d05d1c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:52.954954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6ac2c-3d23-46f3-a063-ce071c48a90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:52.955823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6ac2c-3d23-46f3-a063-ce071c48a90f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:52.956090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6ac2c-3d23-46f3-a063-ce071c48a90f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:52.956365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6ac2c-3d23-46f3-a063-ce071c48a90f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:52.957653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6ac2c-3d23-46f3-a063-ce071c48a90f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:52.959111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6ac2c-3d23-46f3-a063-ce071c48a90f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:52.961061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 512/1026] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:52.967543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227499f-8a3d-44ba-bbb7-914202cb2559 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:53.079115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227499f-8a3d-44ba-bbb7-914202cb2559 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:53.115677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e942f-383c-40db-8614-cf7fa9ccf4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:53.116349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e942f-383c-40db-8614-cf7fa9ccf4cf None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:53.116635 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e942f-383c-40db-8614-cf7fa9ccf4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:53.116916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e942f-383c-40db-8614-cf7fa9ccf4cf None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:53.117642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e942f-383c-40db-8614-cf7fa9ccf4cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:53.119083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e942f-383c-40db-8614-cf7fa9ccf4cf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:53.149991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 515/1027] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:14:52 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:53.843886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffe5cf-6906-412a-8bcc-31a355253df3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:53.844224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffe5cf-6906-412a-8bcc-31a355253df3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:53.844443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffe5cf-6906-412a-8bcc-31a355253df3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:53.845988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 513/1028] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:53.851168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94b46-e111-4bf4-9fe8-c81b5d2e2bc2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:53.851657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94b46-e111-4bf4-9fe8-c81b5d2e2bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:53.851750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94b46-e111-4bf4-9fe8-c81b5d2e2bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:53.869069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f7e94b46-e111-4bf4-9fe8-c81b5d2e2bc2 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:53.870790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f7e94b46-e111-4bf4-9fe8-c81b5d2e2bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:53.919440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:53.944925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 516/1029] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:53 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:53.968241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffe5cf-6906-412a-8bcc-31a355253df3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:53.989319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:54.079774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffe5cf-6906-412a-8bcc-31a355253df3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:54.117252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1bb4c-d71f-473f-90fe-4713090792ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:54.117971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1bb4c-d71f-473f-90fe-4713090792ef None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:54.118248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1bb4c-d71f-473f-90fe-4713090792ef None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:54.118519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1bb4c-d71f-473f-90fe-4713090792ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:54.129272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1bb4c-d71f-473f-90fe-4713090792ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-68c1bb4c-d71f-473f-90fe-4713090792ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:54.137648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:54.138691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:54.139980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:54.143825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 514/1030] 10.222.0.112 () {56 vars in 1125 bytes} [Fri Jun 3 16:14:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:54.144875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e94b46-e111-4bf4-9fe8-c81b5d2e2bc2 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:54.255111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e94b46-e111-4bf4-9fe8-c81b5d2e2bc2 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:54.289962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7dff8-5a99-4358-b9fe-44139ed86148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:54.290633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7dff8-5a99-4358-b9fe-44139ed86148 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:54.290913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7dff8-5a99-4358-b9fe-44139ed86148 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:54.291185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7dff8-5a99-4358-b9fe-44139ed86148 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:54.292539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7dff8-5a99-4358-b9fe-44139ed86148 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:54.292846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7dff8-5a99-4358-b9fe-44139ed86148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:54.294244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7dff8-5a99-4358-b9fe-44139ed86148 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:54.307441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 517/1031] 10.222.0.112 () {56 vars in 1120 bytes} [Fri Jun 3 16:14:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:54.309204 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1bb4c-d71f-473f-90fe-4713090792ef None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:54.390911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:54.414692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1bb4c-d71f-473f-90fe-4713090792ef None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:54.450022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951180-c31f-4318-b13a-81aec157a27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:54.450826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951180-c31f-4318-b13a-81aec157a27c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:54.451111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951180-c31f-4318-b13a-81aec157a27c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:54.451412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951180-c31f-4318-b13a-81aec157a27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:54.462547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951180-c31f-4318-b13a-81aec157a27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:54.464079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951180-c31f-4318-b13a-81aec157a27c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-cf951180-c31f-4318-b13a-81aec157a27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:54.482539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:54.483544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:54.484525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:54.484525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:54.484525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:54.484525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:54.484525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 515/1032] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:54.489551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7dff8-5a99-4358-b9fe-44139ed86148 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:54.534139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:54.594623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7dff8-5a99-4358-b9fe-44139ed86148 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:54.629299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6d870-3663-4b17-b61d-f52709783cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:54.629967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6d870-3663-4b17-b61d-f52709783cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:54.630248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6d870-3663-4b17-b61d-f52709783cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:54.630523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6d870-3663-4b17-b61d-f52709783cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:54.631248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6d870-3663-4b17-b61d-f52709783cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:54.631578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6d870-3663-4b17-b61d-f52709783cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:54.632945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6d870-3663-4b17-b61d-f52709783cf1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:54.649489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 518/1033] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:54.651332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951180-c31f-4318-b13a-81aec157a27c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:54.759208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951180-c31f-4318-b13a-81aec157a27c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:54.788717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:54.796648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20347fa-0441-4a47-81a2-47649c547986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:54.797445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20347fa-0441-4a47-81a2-47649c547986 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:54.797727 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20347fa-0441-4a47-81a2-47649c547986 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:54.798003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20347fa-0441-4a47-81a2-47649c547986 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:54.805790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20347fa-0441-4a47-81a2-47649c547986 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:54.807267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20347fa-0441-4a47-81a2-47649c547986 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a20347fa-0441-4a47-81a2-47649c547986 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:14:54.821243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:54.822248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:54.823242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 516/1034] 10.222.0.112 () {56 vars in 1098 bytes} [Fri Jun 3 16:14:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:54.828283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6d870-3663-4b17-b61d-f52709783cf1 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:54.946555 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6d870-3663-4b17-b61d-f52709783cf1 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:54.948213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:54.985948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84689e-b528-4aed-b46e-a115ef387a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:54.986618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84689e-b528-4aed-b46e-a115ef387a69 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:54.986901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84689e-b528-4aed-b46e-a115ef387a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:54.987179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84689e-b528-4aed-b46e-a115ef387a69 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:54.988066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84689e-b528-4aed-b46e-a115ef387a69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:54.988381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84689e-b528-4aed-b46e-a115ef387a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:54.989813 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84689e-b528-4aed-b46e-a115ef387a69 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:55.012206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 519/1035] 10.222.0.112 () {56 vars in 1138 bytes} [Fri Jun 3 16:14:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:55.014011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20347fa-0441-4a47-81a2-47649c547986 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:55.120149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20347fa-0441-4a47-81a2-47649c547986 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:55.162270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf0c22-0905-4085-8462-0c5503d7f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:55.162929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0c22-0905-4085-8462-0c5503d7f62f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.163218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0c22-0905-4085-8462-0c5503d7f62f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.163495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0c22-0905-4085-8462-0c5503d7f62f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.198898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081e58-8ebf-4673-b133-737ee90dd527 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.199251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081e58-8ebf-4673-b133-737ee90dd527 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.199531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081e58-8ebf-4673-b133-737ee90dd527 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.201068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 520/1036] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:55.207729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3afc-ab53-4a2f-b204-743e1e9665f8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.208261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3afc-ab53-4a2f-b204-743e1e9665f8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.208735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f3afc-ab53-4a2f-b204-743e1e9665f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.231262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:55.231605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5a3f3afc-ab53-4a2f-b204-743e1e9665f8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:55.232929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5a3f3afc-ab53-4a2f-b204-743e1e9665f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:55.243944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf0c22-0905-4085-8462-0c5503d7f62f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:55.246587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf0c22-0905-4085-8462-0c5503d7f62f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:55.304984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 521/1037] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:55 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:14:55.328056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f3afc-ab53-4a2f-b204-743e1e9665f8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:55.366962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 517/1038] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:55 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 16:14:55.368425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf0c22-0905-4085-8462-0c5503d7f62f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:55.430746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:55.441408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f3afc-ab53-4a2f-b204-743e1e9665f8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:55.468442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:55.478677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf0c22-0905-4085-8462-0c5503d7f62f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:55.480290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ff746-bef2-4131-9e67-34c8eb15abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:55.481451 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ff746-bef2-4131-9e67-34c8eb15abce None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.481800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ff746-bef2-4131-9e67-34c8eb15abce None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.482158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ff746-bef2-4131-9e67-34c8eb15abce None admin] PATH_INFO: `/v3/services/image` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.482885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ff746-bef2-4131-9e67-34c8eb15abce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:55.484295 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ff746-bef2-4131-9e67-34c8eb15abce None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-9d6ff746-bef2-4131-9e67-34c8eb15abce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:55.496403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:55.497516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:55.498452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 522/1039] 10.222.0.112 () {56 vars in 1110 bytes} [Fri Jun 3 16:14:55 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:55.499312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153082e8-61b8-4646-bc1b-ff2df7a3c9d0 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.499312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153082e8-61b8-4646-bc1b-ff2df7a3c9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.499312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153082e8-61b8-4646-bc1b-ff2df7a3c9d0 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.500856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 523/1040] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:55.503948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153082e8-61b8-4646-bc1b-ff2df7a3c9d0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:55.518141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a1296-ca57-4e16-b5e4-3cd3c7d0251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:55.518923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1296-ca57-4e16-b5e4-3cd3c7d0251a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.519200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1296-ca57-4e16-b5e4-3cd3c7d0251a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.519474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1296-ca57-4e16-b5e4-3cd3c7d0251a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.529798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1296-ca57-4e16-b5e4-3cd3c7d0251a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:55.531243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1296-ca57-4e16-b5e4-3cd3c7d0251a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-eb7a1296-ca57-4e16-b5e4-3cd3c7d0251a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:55.548338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:55.549335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:55.550466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:55.550466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:55.550466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:55.550466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:55.550466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 518/1041] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:55.551208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9b1d-f041-40c8-aea9-70c419305dd5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.551208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9b1d-f041-40c8-aea9-70c419305dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.551354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca9b1d-f041-40c8-aea9-70c419305dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.567945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b2ca9b1d-f041-40c8-aea9-70c419305dd5 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:55.569142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b2ca9b1d-f041-40c8-aea9-70c419305dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:55.612849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153082e8-61b8-4646-bc1b-ff2df7a3c9d0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:55.638178 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 519/1042] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:55 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:55.639219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca9b1d-f041-40c8-aea9-70c419305dd5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:55.647421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192fe77-46fd-4fd5-9653-6f4f642d1e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:55.648115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192fe77-46fd-4fd5-9653-6f4f642d1e4f None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.648398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192fe77-46fd-4fd5-9653-6f4f642d1e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.648701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192fe77-46fd-4fd5-9653-6f4f642d1e4f None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.649379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192fe77-46fd-4fd5-9653-6f4f642d1e4f None admin] RBAC: Adding query filter params (name=image) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:55.649684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192fe77-46fd-4fd5-9653-6f4f642d1e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:55.651497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192fe77-46fd-4fd5-9653-6f4f642d1e4f None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:55.658010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 524/1043] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:55 2022] GET /identity/v3/services?name=image => generated 123 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:55.663374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192fe77-46fd-4fd5-9653-6f4f642d1e4f None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:55.682668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:55.718404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:55.748231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca9b1d-f041-40c8-aea9-70c419305dd5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:55.765376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192fe77-46fd-4fd5-9653-6f4f642d1e4f None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:55.782008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe0f9d-b34b-4d71-9aa6-5b0d8c938b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:55.782670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe0f9d-b34b-4d71-9aa6-5b0d8c938b75 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.782952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe0f9d-b34b-4d71-9aa6-5b0d8c938b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.783232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe0f9d-b34b-4d71-9aa6-5b0d8c938b75 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.783986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe0f9d-b34b-4d71-9aa6-5b0d8c938b75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:55.784297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe0f9d-b34b-4d71-9aa6-5b0d8c938b75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:55.785682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe0f9d-b34b-4d71-9aa6-5b0d8c938b75 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:55.797151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 520/1044] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:55.797791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe0f9d-b34b-4d71-9aa6-5b0d8c938b75 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:55.800905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e429a-d940-4738-a4e7-b104b33e549e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:55.801889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e429a-d940-4738-a4e7-b104b33e549e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.802177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e429a-d940-4738-a4e7-b104b33e549e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.802452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e429a-d940-4738-a4e7-b104b33e549e None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.803166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e429a-d940-4738-a4e7-b104b33e549e None admin] RBAC: Adding query filter params (type=image) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:55.803471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e429a-d940-4738-a4e7-b104b33e549e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:55.804865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e429a-d940-4738-a4e7-b104b33e549e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:55.810441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 525/1045] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:55 2022] GET /identity/v3/services?type=image => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:55.811290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e429a-d940-4738-a4e7-b104b33e549e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:55.893543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:55.898640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe0f9d-b34b-4d71-9aa6-5b0d8c938b75 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:55.913330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e429a-d940-4738-a4e7-b104b33e549e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:55.927756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:55.933681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333fed5-1f84-4d90-bfee-fd9dc3fee014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:55.934472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333fed5-1f84-4d90-bfee-fd9dc3fee014 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.934776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333fed5-1f84-4d90-bfee-fd9dc3fee014 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.935054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333fed5-1f84-4d90-bfee-fd9dc3fee014 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.936272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333fed5-1f84-4d90-bfee-fd9dc3fee014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:55.937707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333fed5-1f84-4d90-bfee-fd9dc3fee014 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:55.939341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 521/1046] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:55 2022] GET /identity/v3/domains/default => generated 200 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:55.940112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333fed5-1f84-4d90-bfee-fd9dc3fee014 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:55.949576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e7a5-547f-4fdb-a3e3-f3a9a0e955d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:55.950361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e7a5-547f-4fdb-a3e3-f3a9a0e955d0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:55.950639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e7a5-547f-4fdb-a3e3-f3a9a0e955d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:55.950906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e7a5-547f-4fdb-a3e3-f3a9a0e955d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:55.957595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e7a5-547f-4fdb-a3e3-f3a9a0e955d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:55.959024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e7a5-547f-4fdb-a3e3-f3a9a0e955d0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-53d3e7a5-547f-4fdb-a3e3-f3a9a0e955d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:14:55.973777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:55.974905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 526/1047] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:55.976081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e7a5-547f-4fdb-a3e3-f3a9a0e955d0 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:56.045338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333fed5-1f84-4d90-bfee-fd9dc3fee014 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:56.075268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e7a5-547f-4fdb-a3e3-f3a9a0e955d0 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:56.078479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1406743-3e40-471f-af38-9a8c9d1d5f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:56.079129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1406743-3e40-471f-af38-9a8c9d1d5f26 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:56.079413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1406743-3e40-471f-af38-9a8c9d1d5f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:56.079723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1406743-3e40-471f-af38-9a8c9d1d5f26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:56.080464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1406743-3e40-471f-af38-9a8c9d1d5f26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:56.081825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1406743-3e40-471f-af38-9a8c9d1d5f26 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:56.101127 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 522/1048] 10.222.0.112 () {60 vars in 1149 bytes} [Fri Jun 3 16:14:55 2022] POST /identity/v3/endpoints => generated 329 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:56.101942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1406743-3e40-471f-af38-9a8c9d1d5f26 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:56.127788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cba4a-a4f0-4ab8-ace1-771c4aba63a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:56.128511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cba4a-a4f0-4ab8-ace1-771c4aba63a8 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:56.128796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cba4a-a4f0-4ab8-ace1-771c4aba63a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:56.129074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cba4a-a4f0-4ab8-ace1-771c4aba63a8 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:56.129808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cba4a-a4f0-4ab8-ace1-771c4aba63a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:56.131313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cba4a-a4f0-4ab8-ace1-771c4aba63a8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:56.141129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:56.171585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 527/1049] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:14:55 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:14:56.173909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:56.229404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1406743-3e40-471f-af38-9a8c9d1d5f26 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:56.270535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09656c-b874-4fda-a409-5d8074845a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:56.271245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09656c-b874-4fda-a409-5d8074845a02 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:56.271528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09656c-b874-4fda-a409-5d8074845a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:56.271833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09656c-b874-4fda-a409-5d8074845a02 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:56.272685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09656c-b874-4fda-a409-5d8074845a02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:56.272997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09656c-b874-4fda-a409-5d8074845a02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:56.274484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09656c-b874-4fda-a409-5d8074845a02 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:56.295220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 523/1050] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:56.297206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cba4a-a4f0-4ab8-ace1-771c4aba63a8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:56.419016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cba4a-a4f0-4ab8-ace1-771c4aba63a8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:56.455489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87c2b8-8821-4ec0-a089-b0c64bb67e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:56.456185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87c2b8-8821-4ec0-a089-b0c64bb67e4e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:56.456502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87c2b8-8821-4ec0-a089-b0c64bb67e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:56.456752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87c2b8-8821-4ec0-a089-b0c64bb67e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:56.457595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87c2b8-8821-4ec0-a089-b0c64bb67e4e None admin] RBAC: Adding query filter params (role.id=cac2df5a53594fd4823118be07082990, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=3a650b8d49ad480bb1620209a8b7c6e9) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:56.457912 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87c2b8-8821-4ec0-a089-b0c64bb67e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:56.459366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87c2b8-8821-4ec0-a089-b0c64bb67e4e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:56.466305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 528/1051] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:56 2022] GET /identity/v3/role_assignments?user.id=3a650b8d49ad480bb1620209a8b7c6e9&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=cac2df5a53594fd4823118be07082990 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:58.423907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b98bf5-b833-4fc2-9870-ae3c70f63fd2 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:58.424508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b98bf5-b833-4fc2-9870-ae3c70f63fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:58.424508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b98bf5-b833-4fc2-9870-ae3c70f63fd2 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:58.425823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 524/1052] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:58.431259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77022eb6-3363-49b1-a6ad-88f06ee7439b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:58.431697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77022eb6-3363-49b1-a6ad-88f06ee7439b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:58.431909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77022eb6-3363-49b1-a6ad-88f06ee7439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:58.449036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-77022eb6-3363-49b1-a6ad-88f06ee7439b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:58.450230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-77022eb6-3363-49b1-a6ad-88f06ee7439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:58.493895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4ee3-7920-4133-91d4-3008c3d03a41 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:58.494180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4ee3-7920-4133-91d4-3008c3d03a41 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:58.495096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4ee3-7920-4133-91d4-3008c3d03a41 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:58.496630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 525/1053] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:14:58.501703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f6a75-04c5-4ac8-b6e4-d71a0ad5cf60 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:58.501988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f6a75-04c5-4ac8-b6e4-d71a0ad5cf60 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:58.502383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f6a75-04c5-4ac8-b6e4-d71a0ad5cf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:58.506638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:58.520682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e63f6a75-04c5-4ac8-b6e4-d71a0ad5cf60 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:58.521990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e63f6a75-04c5-4ac8-b6e4-d71a0ad5cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:58.523700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 529/1054] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:58 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:58.546433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77022eb6-3363-49b1-a6ad-88f06ee7439b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:58.601206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 526/1055] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:58 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:58.625600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f6a75-04c5-4ac8-b6e4-d71a0ad5cf60 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:58.656751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77022eb6-3363-49b1-a6ad-88f06ee7439b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:58.678449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:58.694401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f7ea4-5112-4503-b9ff-6f56482df6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:58.695039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f7ea4-5112-4503-b9ff-6f56482df6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:58.695323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f7ea4-5112-4503-b9ff-6f56482df6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:58.695626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f7ea4-5112-4503-b9ff-6f56482df6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:58.735107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f6a75-04c5-4ac8-b6e4-d71a0ad5cf60 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:58.752182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:58.765275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f7ea4-5112-4503-b9ff-6f56482df6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:58.766744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f7ea4-5112-4503-b9ff-6f56482df6d0 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:58.768974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45806c0-bb47-4cb6-8156-33156fc9b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:58.769767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45806c0-bb47-4cb6-8156-33156fc9b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:58.770057 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45806c0-bb47-4cb6-8156-33156fc9b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:58.770333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45806c0-bb47-4cb6-8156-33156fc9b3a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:58.781060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45806c0-bb47-4cb6-8156-33156fc9b3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d45806c0-bb47-4cb6-8156-33156fc9b3a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:58.788702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:58.789685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:58.790557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 527/1056] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:58.792089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b290-e181-41ff-89b7-a722e9c40bea None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:58.792089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b290-e181-41ff-89b7-a722e9c40bea None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:58.792230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b290-e181-41ff-89b7-a722e9c40bea None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:58.793616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 528/1057] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:14:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:14:58.798375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b290-e181-41ff-89b7-a722e9c40bea None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:58.868298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 530/1058] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:58 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 16:14:58.869649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412c5e9-598a-4b5c-b432-29428b2fb8a9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:58.869939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412c5e9-598a-4b5c-b432-29428b2fb8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:58.870217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412c5e9-598a-4b5c-b432-29428b2fb8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:58.886139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6412c5e9-598a-4b5c-b432-29428b2fb8a9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:14:58.887328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6412c5e9-598a-4b5c-b432-29428b2fb8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:14:58.904362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b290-e181-41ff-89b7-a722e9c40bea None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:58.911337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:58.941001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a129ed1-2af9-4dbc-8576-0cddaaf877fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:58.941590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129ed1-2af9-4dbc-8576-0cddaaf877fb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:58.941872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129ed1-2af9-4dbc-8576-0cddaaf877fb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:58.942202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129ed1-2af9-4dbc-8576-0cddaaf877fb None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:58.942961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a129ed1-2af9-4dbc-8576-0cddaaf877fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:58.943292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a129ed1-2af9-4dbc-8576-0cddaaf877fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:58.944728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a129ed1-2af9-4dbc-8576-0cddaaf877fb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:58.953683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 529/1059] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:14:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:58.954611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a129ed1-2af9-4dbc-8576-0cddaaf877fb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:58.966976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 531/1060] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:14:58 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:14:58.968280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412c5e9-598a-4b5c-b432-29428b2fb8a9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:58.988712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:59.058825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a129ed1-2af9-4dbc-8576-0cddaaf877fb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.070317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412c5e9-598a-4b5c-b432-29428b2fb8a9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.093488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4e1d5-2666-4f18-a5a1-9aaca27eda0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.094269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4e1d5-2666-4f18-a5a1-9aaca27eda0a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.094546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4e1d5-2666-4f18-a5a1-9aaca27eda0a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.094823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4e1d5-2666-4f18-a5a1-9aaca27eda0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:59.105690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea50e32-64c8-404c-a92a-8dbde3b18772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.106098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4e1d5-2666-4f18-a5a1-9aaca27eda0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:59.106982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea50e32-64c8-404c-a92a-8dbde3b18772 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.107394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea50e32-64c8-404c-a92a-8dbde3b18772 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.107652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea50e32-64c8-404c-a92a-8dbde3b18772 None admin] PATH_INFO: `/v3/users/042fcd84294246c098c663848ec31c66` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:59.107850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4e1d5-2666-4f18-a5a1-9aaca27eda0a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:59.121948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea50e32-64c8-404c-a92a-8dbde3b18772 None admin] RBAC: Authorizing `identity:get_user(user_id=042fcd84294246c098c663848ec31c66)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:59.123535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea50e32-64c8-404c-a92a-8dbde3b18772 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:59.125418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 532/1061] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:14:58 2022] GET /identity/v3/users/042fcd84294246c098c663848ec31c66 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-90f4e1d5-2666-4f18-a5a1-9aaca27eda0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:59.125897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:59.126849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:59.128035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:59.128035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:59.128035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:59.128035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:59.128312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea50e32-64c8-404c-a92a-8dbde3b18772 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:59.128395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 530/1062] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:59.131732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4e1d5-2666-4f18-a5a1-9aaca27eda0a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:59.154722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:59.208738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:59.236243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4e1d5-2666-4f18-a5a1-9aaca27eda0a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.242818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea50e32-64c8-404c-a92a-8dbde3b18772 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.270968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7267a3-efdb-4e5c-8389-eee0aef3a4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.271639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7267a3-efdb-4e5c-8389-eee0aef3a4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.271929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7267a3-efdb-4e5c-8389-eee0aef3a4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.272209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7267a3-efdb-4e5c-8389-eee0aef3a4a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:59.277855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82f763-d23b-4451-8ec6-1015a34ad9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.278657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82f763-d23b-4451-8ec6-1015a34ad9ee None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.278943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82f763-d23b-4451-8ec6-1015a34ad9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.279217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82f763-d23b-4451-8ec6-1015a34ad9ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:59.289969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82f763-d23b-4451-8ec6-1015a34ad9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5d82f763-d23b-4451-8ec6-1015a34ad9ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:14:59.298169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:59.299243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 533/1063] 10.222.0.112 () {56 vars in 1125 bytes} [Fri Jun 3 16:14:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:14:59.300178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82f763-d23b-4451-8ec6-1015a34ad9ee None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:59.345136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7267a3-efdb-4e5c-8389-eee0aef3a4a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:59.346616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7267a3-efdb-4e5c-8389-eee0aef3a4a6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:59.368584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:59.407273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82f763-d23b-4451-8ec6-1015a34ad9ee None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.441815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cb2dc-2bbf-4382-bab7-1941b4a06308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.442486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cb2dc-2bbf-4382-bab7-1941b4a06308 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.442741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cb2dc-2bbf-4382-bab7-1941b4a06308 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.443014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cb2dc-2bbf-4382-bab7-1941b4a06308 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:59.443765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cb2dc-2bbf-4382-bab7-1941b4a06308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:59.444071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cb2dc-2bbf-4382-bab7-1941b4a06308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:59.445432 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cb2dc-2bbf-4382-bab7-1941b4a06308 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:59.447744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:59.449266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 531/1064] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:14:59 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 16:14:59.450116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7267a3-efdb-4e5c-8389-eee0aef3a4a6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:59.459838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 534/1065] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:59.460593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cb2dc-2bbf-4382-bab7-1941b4a06308 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:59.572452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7267a3-efdb-4e5c-8389-eee0aef3a4a6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.591269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cb2dc-2bbf-4382-bab7-1941b4a06308 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.596468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:59.617513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872086e-1be7-4f44-8121-72e845341021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.619073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872086e-1be7-4f44-8121-72e845341021 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.619377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872086e-1be7-4f44-8121-72e845341021 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.619691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872086e-1be7-4f44-8121-72e845341021 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:59.620762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872086e-1be7-4f44-8121-72e845341021 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:59.621100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872086e-1be7-4f44-8121-72e845341021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:59.623477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872086e-1be7-4f44-8121-72e845341021 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:59.630493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860551ce-9e68-47e9-affc-4fd6bf4f4b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.631382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860551ce-9e68-47e9-affc-4fd6bf4f4b51 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.631762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860551ce-9e68-47e9-affc-4fd6bf4f4b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.632036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860551ce-9e68-47e9-affc-4fd6bf4f4b51 None admin] PATH_INFO: `/v3/projects/35629d8f7b9d4d52843cb01f0d390fec` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:59.634547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 532/1066] 10.222.0.112 () {56 vars in 1120 bytes} [Fri Jun 3 16:14:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:59.635838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860551ce-9e68-47e9-affc-4fd6bf4f4b51 None admin] RBAC: Authorizing `identity:get_project(project_id=35629d8f7b9d4d52843cb01f0d390fec)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:59.637328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860551ce-9e68-47e9-affc-4fd6bf4f4b51 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:59.639302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 535/1067] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:14:59 2022] GET /identity/v3/projects/35629d8f7b9d4d52843cb01f0d390fec => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:14:59.641601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872086e-1be7-4f44-8121-72e845341021 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:59.645223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860551ce-9e68-47e9-affc-4fd6bf4f4b51 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:59.721054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:59.765872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872086e-1be7-4f44-8121-72e845341021 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.767453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860551ce-9e68-47e9-affc-4fd6bf4f4b51 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.804377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5e518-fabb-44fe-bafe-77472058b9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.805166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5e518-fabb-44fe-bafe-77472058b9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.805449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5e518-fabb-44fe-bafe-77472058b9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.805723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5e518-fabb-44fe-bafe-77472058b9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:59.806931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cb300-ba36-4958-9ee3-d8117660209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.807601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb300-ba36-4958-9ee3-d8117660209e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.807885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb300-ba36-4958-9ee3-d8117660209e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.808167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cb300-ba36-4958-9ee3-d8117660209e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:14:59.808998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cb300-ba36-4958-9ee3-d8117660209e None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=35629d8f7b9d4d52843cb01f0d390fec, user.id=042fcd84294246c098c663848ec31c66) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:14:59.809307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cb300-ba36-4958-9ee3-d8117660209e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:59.810749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cb300-ba36-4958-9ee3-d8117660209e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:59.816269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 536/1068] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:14:59 2022] GET /identity/v3/role_assignments?user.id=042fcd84294246c098c663848ec31c66&scope.project.id=35629d8f7b9d4d52843cb01f0d390fec&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:14:59.816463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5e518-fabb-44fe-bafe-77472058b9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:14:59.817904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5e518-fabb-44fe-bafe-77472058b9d0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-60d5e518-fabb-44fe-bafe-77472058b9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:14:59.841368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:14:59.842521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:14:59.843638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:14:59.843638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:14:59.843638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:14:59.843638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:14:59.843638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 533/1069] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:14:59.848729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cb300-ba36-4958-9ee3-d8117660209e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:14:59.956947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cb300-ba36-4958-9ee3-d8117660209e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:14:59.986036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:14:59.998040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763114ed-e6f2-421b-b658-276258c77a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:14:59.998737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763114ed-e6f2-421b-b658-276258c77a44 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:14:59.999087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763114ed-e6f2-421b-b658-276258c77a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:14:59.999345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763114ed-e6f2-421b-b658-276258c77a44 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:00.000443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763114ed-e6f2-421b-b658-276258c77a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:00.000443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763114ed-e6f2-421b-b658-276258c77a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:00.002027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763114ed-e6f2-421b-b658-276258c77a44 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:00.014559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 537/1070] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:14:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:00.020455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5e518-fabb-44fe-bafe-77472058b9d0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:00.056128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:00.122027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5e518-fabb-44fe-bafe-77472058b9d0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:00.154776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52fac1-4838-4624-ad69-80fc3b383a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:00.155574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52fac1-4838-4624-ad69-80fc3b383a04 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:00.155886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52fac1-4838-4624-ad69-80fc3b383a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:00.156163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52fac1-4838-4624-ad69-80fc3b383a04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:00.164212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52fac1-4838-4624-ad69-80fc3b383a04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:00.165668 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52fac1-4838-4624-ad69-80fc3b383a04 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5f52fac1-4838-4624-ad69-80fc3b383a04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:15:00.179860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:00.181028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:00.182995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 534/1071] 10.222.0.112 () {56 vars in 1098 bytes} [Fri Jun 3 16:15:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:00.187338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763114ed-e6f2-421b-b658-276258c77a44 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:00.288209 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763114ed-e6f2-421b-b658-276258c77a44 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:00.321530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e54c4-e11d-4dde-92d0-8abf320bde07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:00.322193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e54c4-e11d-4dde-92d0-8abf320bde07 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:00.323041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e54c4-e11d-4dde-92d0-8abf320bde07 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:00.323318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e54c4-e11d-4dde-92d0-8abf320bde07 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:00.324186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e54c4-e11d-4dde-92d0-8abf320bde07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:00.324496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e54c4-e11d-4dde-92d0-8abf320bde07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:00.325938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e54c4-e11d-4dde-92d0-8abf320bde07 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:00.342979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 538/1072] 10.222.0.112 () {56 vars in 1138 bytes} [Fri Jun 3 16:15:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:00.348551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52fac1-4838-4624-ad69-80fc3b383a04 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:00.441880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:00.448861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52fac1-4838-4624-ad69-80fc3b383a04 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:00.481733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631b67b-f7df-4109-b9b2-60666b7ac2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:00.482517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631b67b-f7df-4109-b9b2-60666b7ac2fd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:00.482799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631b67b-f7df-4109-b9b2-60666b7ac2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:00.483074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631b67b-f7df-4109-b9b2-60666b7ac2fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:00.493478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631b67b-f7df-4109-b9b2-60666b7ac2fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:00.495499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631b67b-f7df-4109-b9b2-60666b7ac2fd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8631b67b-f7df-4109-b9b2-60666b7ac2fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:15:00.512330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:00.513350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:00.514633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:15:00.514633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:15:00.514633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:15:00.514633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:00.514633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 535/1073] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:00.519173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e54c4-e11d-4dde-92d0-8abf320bde07 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:00.566879 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:00.621027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e54c4-e11d-4dde-92d0-8abf320bde07 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:00.654427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7328e5-dd7d-4414-bbc0-b827ad1fe5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:00.655091 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7328e5-dd7d-4414-bbc0-b827ad1fe5ff None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:00.655375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7328e5-dd7d-4414-bbc0-b827ad1fe5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:00.655693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7328e5-dd7d-4414-bbc0-b827ad1fe5ff None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:00.656424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7328e5-dd7d-4414-bbc0-b827ad1fe5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:00.656740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7328e5-dd7d-4414-bbc0-b827ad1fe5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:00.658112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7328e5-dd7d-4414-bbc0-b827ad1fe5ff None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:00.669818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 539/1074] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:15:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:00.675438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631b67b-f7df-4109-b9b2-60666b7ac2fd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:00.773864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631b67b-f7df-4109-b9b2-60666b7ac2fd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:00.807268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbff2d2-36e8-441a-ae0b-fe46b6bbec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:00.808083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbff2d2-36e8-441a-ae0b-fe46b6bbec4f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:00.808366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbff2d2-36e8-441a-ae0b-fe46b6bbec4f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:00.808643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbff2d2-36e8-441a-ae0b-fe46b6bbec4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:00.815139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbff2d2-36e8-441a-ae0b-fe46b6bbec4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:00.816623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbff2d2-36e8-441a-ae0b-fe46b6bbec4f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-bbbff2d2-36e8-441a-ae0b-fe46b6bbec4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:15:00.830604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:00.831680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:00.832785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:15:00.832785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:15:00.832785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:15:00.832785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:15:00.832785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:15:00.832785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:15:00.832785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:15:00.832785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:00.835695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 536/1075] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:00.837495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7328e5-dd7d-4414-bbc0-b827ad1fe5ff None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:00.938063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7328e5-dd7d-4414-bbc0-b827ad1fe5ff None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:00.945212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:00.972705 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bb1f2-6ef2-4ce5-932c-1989982f9ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:00.973269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bb1f2-6ef2-4ce5-932c-1989982f9ffe None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:00.973560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bb1f2-6ef2-4ce5-932c-1989982f9ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:00.973836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bb1f2-6ef2-4ce5-932c-1989982f9ffe None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:00.974625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bb1f2-6ef2-4ce5-932c-1989982f9ffe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:00.974938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bb1f2-6ef2-4ce5-932c-1989982f9ffe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:00.976411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bb1f2-6ef2-4ce5-932c-1989982f9ffe None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:00.990525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 540/1076] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:00.996352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbff2d2-36e8-441a-ae0b-fe46b6bbec4f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:01.005216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:01.094471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbff2d2-36e8-441a-ae0b-fe46b6bbec4f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:01.128611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9edd6c-03bd-4196-9e53-bc8594ee167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:01.129489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9edd6c-03bd-4196-9e53-bc8594ee167e None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:01.129771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9edd6c-03bd-4196-9e53-bc8594ee167e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:01.130045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9edd6c-03bd-4196-9e53-bc8594ee167e None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/3a650b8d49ad480bb1620209a8b7c6e9/roles/cac2df5a53594fd4823118be07082990` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:01.132256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9edd6c-03bd-4196-9e53-bc8594ee167e None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=3a650b8d49ad480bb1620209a8b7c6e9, role_id=cac2df5a53594fd4823118be07082990)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:01.133693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9edd6c-03bd-4196-9e53-bc8594ee167e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:01.147018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 537/1077] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:15:00 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/3a650b8d49ad480bb1620209a8b7c6e9/roles/cac2df5a53594fd4823118be07082990 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:15:02.079129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c790540-ae12-41d4-8f5c-882cadffce7a None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:02.079712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c790540-ae12-41d4-8f5c-882cadffce7a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:02.079712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c790540-ae12-41d4-8f5c-882cadffce7a None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:02.081076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 541/1078] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:02.086326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb19daf-4ce1-4f6c-a399-b6559fd29ba9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:02.086757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb19daf-4ce1-4f6c-a399-b6559fd29ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:02.087008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb19daf-4ce1-4f6c-a399-b6559fd29ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:02.103407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7cb19daf-4ce1-4f6c-a399-b6559fd29ba9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:02.105136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7cb19daf-4ce1-4f6c-a399-b6559fd29ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:02.162690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:02.171702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 538/1079] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:02 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:02.195084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c790540-ae12-41d4-8f5c-882cadffce7a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:02.317075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c790540-ae12-41d4-8f5c-882cadffce7a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:02.351669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8534e6-973c-4ce0-8cd5-95962d7917ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:02.352378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8534e6-973c-4ce0-8cd5-95962d7917ac None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:02.352658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8534e6-973c-4ce0-8cd5-95962d7917ac None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:02.352936 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8534e6-973c-4ce0-8cd5-95962d7917ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:02.364087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8534e6-973c-4ce0-8cd5-95962d7917ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-cf8534e6-973c-4ce0-8cd5-95962d7917ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:15:02.373672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:02.374691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:15:02.375601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 542/1080] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:02.381501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb19daf-4ce1-4f6c-a399-b6559fd29ba9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:02.481423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb19daf-4ce1-4f6c-a399-b6559fd29ba9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:02.514988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f780710-74ad-4791-92dc-e148f90e3118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:02.515671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f780710-74ad-4791-92dc-e148f90e3118 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:02.515956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f780710-74ad-4791-92dc-e148f90e3118 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:02.516233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f780710-74ad-4791-92dc-e148f90e3118 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:02.516979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f780710-74ad-4791-92dc-e148f90e3118 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:02.517288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f780710-74ad-4791-92dc-e148f90e3118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:02.518650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f780710-74ad-4791-92dc-e148f90e3118 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:02.527163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 539/1081] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:15:02 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:02.533060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8534e6-973c-4ce0-8cd5-95962d7917ac None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:02.561341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:02.633055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8534e6-973c-4ce0-8cd5-95962d7917ac None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:02.667567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906324ba-5a19-474b-b079-9047657ca08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:02.668441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906324ba-5a19-474b-b079-9047657ca08e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:02.668725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906324ba-5a19-474b-b079-9047657ca08e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:02.669002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906324ba-5a19-474b-b079-9047657ca08e None admin] PATH_INFO: `/v3/users/042fcd84294246c098c663848ec31c66` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:02.670181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906324ba-5a19-474b-b079-9047657ca08e None admin] RBAC: Authorizing `identity:get_user(user_id=042fcd84294246c098c663848ec31c66)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:02.671658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906324ba-5a19-474b-b079-9047657ca08e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:02.673447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 543/1082] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:02 2022] GET /identity/v3/users/042fcd84294246c098c663848ec31c66 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:02.678950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f780710-74ad-4791-92dc-e148f90e3118 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:02.739865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:02.784162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f780710-74ad-4791-92dc-e148f90e3118 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:02.817057 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c289dfc-2831-4f3c-b49e-cd12c3882f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:02.817915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c289dfc-2831-4f3c-b49e-cd12c3882f05 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:02.818211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c289dfc-2831-4f3c-b49e-cd12c3882f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:02.818476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c289dfc-2831-4f3c-b49e-cd12c3882f05 None admin] PATH_INFO: `/v3/projects/35629d8f7b9d4d52843cb01f0d390fec` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:02.819685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c289dfc-2831-4f3c-b49e-cd12c3882f05 None admin] RBAC: Authorizing `identity:get_project(project_id=35629d8f7b9d4d52843cb01f0d390fec)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:02.821128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c289dfc-2831-4f3c-b49e-cd12c3882f05 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:02.823406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 540/1083] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:02 2022] GET /identity/v3/projects/35629d8f7b9d4d52843cb01f0d390fec => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:02.830573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906324ba-5a19-474b-b079-9047657ca08e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:02.926147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:02.933203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906324ba-5a19-474b-b079-9047657ca08e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:02.966926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02c983-59cb-45d3-9326-d8b8b0b42362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:02.967839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c983-59cb-45d3-9326-d8b8b0b42362 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:02.968119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c983-59cb-45d3-9326-d8b8b0b42362 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:02.968394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c983-59cb-45d3-9326-d8b8b0b42362 None admin] PATH_INFO: `/v3/projects/35629d8f7b9d4d52843cb01f0d390fec/users/042fcd84294246c098c663848ec31c66/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:02.970336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02c983-59cb-45d3-9326-d8b8b0b42362 None admin] RBAC: Authorizing `identity:create_grant(project_id=35629d8f7b9d4d52843cb01f0d390fec, user_id=042fcd84294246c098c663848ec31c66, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:02.971809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02c983-59cb-45d3-9326-d8b8b0b42362 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:02.984992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 544/1084] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:15:02 2022] PUT /identity/v3/projects/35629d8f7b9d4d52843cb01f0d390fec/users/042fcd84294246c098c663848ec31c66/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:15:03.372674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643a7a-fab7-407b-8842-bc9ca3f803e9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:03.373282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643a7a-fab7-407b-8842-bc9ca3f803e9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:03.373282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7643a7a-fab7-407b-8842-bc9ca3f803e9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:03.374605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 541/1085] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:03.380374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d38448-af8b-49c0-be46-936dae0124bf None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:03.380835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d38448-af8b-49c0-be46-936dae0124bf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:03.381077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d38448-af8b-49c0-be46-936dae0124bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:03.399096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-38d38448-af8b-49c0-be46-936dae0124bf None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:03.400314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-38d38448-af8b-49c0-be46-936dae0124bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:03.466590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 545/1086] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:03 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:03.490752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7643a7a-fab7-407b-8842-bc9ca3f803e9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:03.592629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7643a7a-fab7-407b-8842-bc9ca3f803e9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:03.618226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:03.628376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171eff9-d460-418b-a07d-f920c3762e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:03.629116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171eff9-d460-418b-a07d-f920c3762e22 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:03.629401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171eff9-d460-418b-a07d-f920c3762e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:03.629677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171eff9-d460-418b-a07d-f920c3762e22 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:03.640143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171eff9-d460-418b-a07d-f920c3762e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-0171eff9-d460-418b-a07d-f920c3762e22 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:15:03.648405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:03.649400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:03.650267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 542/1087] 10.222.0.112 () {56 vars in 1125 bytes} [Fri Jun 3 16:15:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:03.655690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d38448-af8b-49c0-be46-936dae0124bf None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:03.739862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:03.757083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d38448-af8b-49c0-be46-936dae0124bf None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:03.790654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a3612-ac91-49ba-9631-799f3b6f8d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:03.791911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a3612-ac91-49ba-9631-799f3b6f8d42 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:03.792192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a3612-ac91-49ba-9631-799f3b6f8d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:03.792466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a3612-ac91-49ba-9631-799f3b6f8d42 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:03.793215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a3612-ac91-49ba-9631-799f3b6f8d42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:03.793529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a3612-ac91-49ba-9631-799f3b6f8d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:03.794899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a3612-ac91-49ba-9631-799f3b6f8d42 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:03.803021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 546/1088] 10.222.0.112 () {56 vars in 1120 bytes} [Fri Jun 3 16:15:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:03.808729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171eff9-d460-418b-a07d-f920c3762e22 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:03.904802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171eff9-d460-418b-a07d-f920c3762e22 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:03.938759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d7752-2b5e-40c1-9874-6f093d07c5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:03.939943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d7752-2b5e-40c1-9874-6f093d07c5de None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:03.940220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d7752-2b5e-40c1-9874-6f093d07c5de None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:03.940494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d7752-2b5e-40c1-9874-6f093d07c5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:03.950347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d7752-2b5e-40c1-9874-6f093d07c5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:03.951856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d7752-2b5e-40c1-9874-6f093d07c5de None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e51d7752-2b5e-40c1-9874-6f093d07c5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:15:03.969716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:03.970651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:03.971779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:15:03.971779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:15:03.971779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:15:03.971779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:03.971779 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 543/1089] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:15:03.976659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a3612-ac91-49ba-9631-799f3b6f8d42 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:04.076076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a3612-ac91-49ba-9631-799f3b6f8d42 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:04.110876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824ec64-5ad1-454b-9da4-cee3b5500867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:04.111577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824ec64-5ad1-454b-9da4-cee3b5500867 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:04.111866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824ec64-5ad1-454b-9da4-cee3b5500867 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:04.112138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824ec64-5ad1-454b-9da4-cee3b5500867 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:04.112879 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824ec64-5ad1-454b-9da4-cee3b5500867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:04.113179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824ec64-5ad1-454b-9da4-cee3b5500867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:04.114601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824ec64-5ad1-454b-9da4-cee3b5500867 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:04.128476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 547/1090] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:15:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:04.133940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d7752-2b5e-40c1-9874-6f093d07c5de None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:04.177772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:04.240298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d7752-2b5e-40c1-9874-6f093d07c5de None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:04.274553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb687a-9816-4095-a171-b102b08a273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:04.275406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb687a-9816-4095-a171-b102b08a273d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:04.276213 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb687a-9816-4095-a171-b102b08a273d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:04.276494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb687a-9816-4095-a171-b102b08a273d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:04.283870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb687a-9816-4095-a171-b102b08a273d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:04.285320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb687a-9816-4095-a171-b102b08a273d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-dedb687a-9816-4095-a171-b102b08a273d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:15:04.300228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:04.301231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:04.302568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 544/1091] 10.222.0.112 () {56 vars in 1098 bytes} [Fri Jun 3 16:15:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:04.307176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824ec64-5ad1-454b-9da4-cee3b5500867 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:04.315988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:04.408735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824ec64-5ad1-454b-9da4-cee3b5500867 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:04.441298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4b7b3-2882-4c08-a3a8-2a0744e593f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:04.441895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4b7b3-2882-4c08-a3a8-2a0744e593f6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:04.442180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4b7b3-2882-4c08-a3a8-2a0744e593f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:04.442456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4b7b3-2882-4c08-a3a8-2a0744e593f6 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:04.443288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4b7b3-2882-4c08-a3a8-2a0744e593f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:04.443622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4b7b3-2882-4c08-a3a8-2a0744e593f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:04.445095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4b7b3-2882-4c08-a3a8-2a0744e593f6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:04.462427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 548/1092] 10.222.0.112 () {56 vars in 1138 bytes} [Fri Jun 3 16:15:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:04.468636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb687a-9816-4095-a171-b102b08a273d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:04.563572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:04.568219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb687a-9816-4095-a171-b102b08a273d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:04.603146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a0aef-9b42-4f28-8a2c-d9203b88857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:04.603854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a0aef-9b42-4f28-8a2c-d9203b88857c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:04.604143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a0aef-9b42-4f28-8a2c-d9203b88857c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:04.604424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a0aef-9b42-4f28-8a2c-d9203b88857c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:04.671374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a0aef-9b42-4f28-8a2c-d9203b88857c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:04.672883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a0aef-9b42-4f28-8a2c-d9203b88857c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:04.766788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:04.771701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 545/1093] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:15:04 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:15:04.777268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4b7b3-2882-4c08-a3a8-2a0744e593f6 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:04.838700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:04.877264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4b7b3-2882-4c08-a3a8-2a0744e593f6 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:04.912052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe4de1-ff78-40a0-9762-853a19cc15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:04.912847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe4de1-ff78-40a0-9762-853a19cc15c7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:04.913141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe4de1-ff78-40a0-9762-853a19cc15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:04.913393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe4de1-ff78-40a0-9762-853a19cc15c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:04.925898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe4de1-ff78-40a0-9762-853a19cc15c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:04.927415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe4de1-ff78-40a0-9762-853a19cc15c7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-e7fe4de1-ff78-40a0-9762-853a19cc15c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:15:04.947983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:04.949024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:04.950005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:15:04.950005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:15:04.950005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:15:04.950005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:15:04.950005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 549/1094] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:15:04.955173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a0aef-9b42-4f28-8a2c-d9203b88857c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:05.054572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a0aef-9b42-4f28-8a2c-d9203b88857c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:05.088165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31e813-90fa-496e-8c28-df4690d77b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:05.088826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e813-90fa-496e-8c28-df4690d77b8f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:05.089109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e813-90fa-496e-8c28-df4690d77b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:05.089388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31e813-90fa-496e-8c28-df4690d77b8f None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:05.090113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31e813-90fa-496e-8c28-df4690d77b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:05.090423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31e813-90fa-496e-8c28-df4690d77b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:05.091835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31e813-90fa-496e-8c28-df4690d77b8f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:05.102767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 546/1095] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:15:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:15:05.109311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe4de1-ff78-40a0-9762-853a19cc15c7 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:05.212215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe4de1-ff78-40a0-9762-853a19cc15c7 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:05.230528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:05.249562 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781899b9-0c2d-4f60-a2a1-5e48d1658652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:05.250378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781899b9-0c2d-4f60-a2a1-5e48d1658652 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:05.250658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781899b9-0c2d-4f60-a2a1-5e48d1658652 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:05.250956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781899b9-0c2d-4f60-a2a1-5e48d1658652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:05.257712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781899b9-0c2d-4f60-a2a1-5e48d1658652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:05.259159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781899b9-0c2d-4f60-a2a1-5e48d1658652 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:05.261266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1011a9-18bd-4c9e-b513-41efed4849a4 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:05.261563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1011a9-18bd-4c9e-b513-41efed4849a4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:05.261845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1011a9-18bd-4c9e-b513-41efed4849a4 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:05.263205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 547/1096] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:15:05.268150 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c882aec-fef7-4ca5-b300-65e9bfd0fb1b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:05.268435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c882aec-fef7-4ca5-b300-65e9bfd0fb1b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:05.268711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c882aec-fef7-4ca5-b300-65e9bfd0fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-781899b9-0c2d-4f60-a2a1-5e48d1658652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:15:05.273109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:05.274179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:05.275851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:15:05.275851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:15:05.275851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:15:05.275851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:15:05.275851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:15:05.275851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:15:05.275851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:15:05.275851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:15:05.279707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 550/1097] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:05.281640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781899b9-0c2d-4f60-a2a1-5e48d1658652 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:05.285975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3c882aec-fef7-4ca5-b300-65e9bfd0fb1b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:05.287188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3c882aec-fef7-4ca5-b300-65e9bfd0fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:05.340504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:05.356292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 548/1098] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:05 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:15:05.380022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c882aec-fef7-4ca5-b300-65e9bfd0fb1b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:05.383054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781899b9-0c2d-4f60-a2a1-5e48d1658652 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:05.417510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e26171-25c2-49b5-8fb2-c169db6a91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:05.418226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e26171-25c2-49b5-8fb2-c169db6a91d5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:05.418512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e26171-25c2-49b5-8fb2-c169db6a91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:05.418790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e26171-25c2-49b5-8fb2-c169db6a91d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:05.419600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e26171-25c2-49b5-8fb2-c169db6a91d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:05.419915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e26171-25c2-49b5-8fb2-c169db6a91d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:05.421362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e26171-25c2-49b5-8fb2-c169db6a91d5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:05.433385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 551/1099] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:15:05.439672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e26171-25c2-49b5-8fb2-c169db6a91d5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:05.474222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:05.480566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c882aec-fef7-4ca5-b300-65e9bfd0fb1b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:05.513312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200efdd-502d-4e02-94b4-710552033b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:05.514093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200efdd-502d-4e02-94b4-710552033b4d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:05.514375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200efdd-502d-4e02-94b4-710552033b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:05.514645 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200efdd-502d-4e02-94b4-710552033b4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:05.534427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200efdd-502d-4e02-94b4-710552033b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:15:05.539625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e26171-25c2-49b5-8fb2-c169db6a91d5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f200efdd-502d-4e02-94b4-710552033b4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:15:05.544961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:05.546085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:05.546968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 549/1100] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:15:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:15:05.552324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200efdd-502d-4e02-94b4-710552033b4d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:05.575810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488012d7-9ea9-42f9-ad46-facb9f9b2090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:05.576471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488012d7-9ea9-42f9-ad46-facb9f9b2090 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:05.576755 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488012d7-9ea9-42f9-ad46-facb9f9b2090 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:05.577040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488012d7-9ea9-42f9-ad46-facb9f9b2090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:05.577865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488012d7-9ea9-42f9-ad46-facb9f9b2090 None admin] RBAC: Adding query filter params (role.id=cac2df5a53594fd4823118be07082990, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=3a650b8d49ad480bb1620209a8b7c6e9) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:05.578180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488012d7-9ea9-42f9-ad46-facb9f9b2090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:05.579637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488012d7-9ea9-42f9-ad46-facb9f9b2090 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:05.596553 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 552/1101] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:15:05 2022] GET /identity/v3/role_assignments?user.id=3a650b8d49ad480bb1620209a8b7c6e9&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=cac2df5a53594fd4823118be07082990 => generated 610 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:15:05.605378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:05.663391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200efdd-502d-4e02-94b4-710552033b4d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:05.699848 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccef2b-a7e2-42a6-9391-0bd6da45d5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:05.700534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccef2b-a7e2-42a6-9391-0bd6da45d5cd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:05.700820 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccef2b-a7e2-42a6-9391-0bd6da45d5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:05.701183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccef2b-a7e2-42a6-9391-0bd6da45d5cd None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:05.702063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccef2b-a7e2-42a6-9391-0bd6da45d5cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:05.702205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccef2b-a7e2-42a6-9391-0bd6da45d5cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:05.703634 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccef2b-a7e2-42a6-9391-0bd6da45d5cd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:05.713928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 550/1102] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:15:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:15:05.719939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488012d7-9ea9-42f9-ad46-facb9f9b2090 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:05.820922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:05.824169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488012d7-9ea9-42f9-ad46-facb9f9b2090 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:05.859500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da908e8-50e6-4ca3-9c95-dd8bb240de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:05.860336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da908e8-50e6-4ca3-9c95-dd8bb240de71 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:05.860615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da908e8-50e6-4ca3-9c95-dd8bb240de71 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:05.860885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da908e8-50e6-4ca3-9c95-dd8bb240de71 None admin] PATH_INFO: `/v3/users/042fcd84294246c098c663848ec31c66` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:05.862058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da908e8-50e6-4ca3-9c95-dd8bb240de71 None admin] RBAC: Authorizing `identity:get_user(user_id=042fcd84294246c098c663848ec31c66)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:05.863479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da908e8-50e6-4ca3-9c95-dd8bb240de71 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:05.865130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 553/1103] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:05 2022] GET /identity/v3/users/042fcd84294246c098c663848ec31c66 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:05.872736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccef2b-a7e2-42a6-9391-0bd6da45d5cd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:05.977445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccef2b-a7e2-42a6-9391-0bd6da45d5cd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:05.988509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:06.013932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab2623-5e62-4293-a051-daf8b096d37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:06.014573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab2623-5e62-4293-a051-daf8b096d37c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:06.014850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab2623-5e62-4293-a051-daf8b096d37c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:06.015121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab2623-5e62-4293-a051-daf8b096d37c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:06.086398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab2623-5e62-4293-a051-daf8b096d37c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:06.087916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab2623-5e62-4293-a051-daf8b096d37c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:06.189911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 551/1104] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:15:05 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:15:06.195788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da908e8-50e6-4ca3-9c95-dd8bb240de71 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:06.303917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da908e8-50e6-4ca3-9c95-dd8bb240de71 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:06.339301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07d0bd-31b9-43e9-a171-0d55fb9b6e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:06.340190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07d0bd-31b9-43e9-a171-0d55fb9b6e1e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:06.340474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07d0bd-31b9-43e9-a171-0d55fb9b6e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:06.340749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07d0bd-31b9-43e9-a171-0d55fb9b6e1e None admin] PATH_INFO: `/v3/projects/35629d8f7b9d4d52843cb01f0d390fec` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:06.341938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07d0bd-31b9-43e9-a171-0d55fb9b6e1e None admin] RBAC: Authorizing `identity:get_project(project_id=35629d8f7b9d4d52843cb01f0d390fec)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:06.343371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07d0bd-31b9-43e9-a171-0d55fb9b6e1e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:06.345093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 554/1105] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:06 2022] GET /identity/v3/projects/35629d8f7b9d4d52843cb01f0d390fec => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:06.351224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab2623-5e62-4293-a051-daf8b096d37c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:06.363824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:06.454105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab2623-5e62-4293-a051-daf8b096d37c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:06.489808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9f07a-b204-4644-860c-137b530fd6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:06.490469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9f07a-b204-4644-860c-137b530fd6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:06.490754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9f07a-b204-4644-860c-137b530fd6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:06.491034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9f07a-b204-4644-860c-137b530fd6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:06.492008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9f07a-b204-4644-860c-137b530fd6d4 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=35629d8f7b9d4d52843cb01f0d390fec, user.id=042fcd84294246c098c663848ec31c66) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:06.492322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9f07a-b204-4644-860c-137b530fd6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:06.493772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9f07a-b204-4644-860c-137b530fd6d4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:06.500507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 552/1106] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:15:06 2022] GET /identity/v3/role_assignments?user.id=042fcd84294246c098c663848ec31c66&scope.project.id=35629d8f7b9d4d52843cb01f0d390fec&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 610 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:08.739255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35603fa-75dc-4f37-8bf9-543393a7e486 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:08.739841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35603fa-75dc-4f37-8bf9-543393a7e486 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:08.739841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35603fa-75dc-4f37-8bf9-543393a7e486 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:08.741207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 555/1107] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:08.746399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4f82-9c29-44b6-becc-915728ec89d4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:08.746803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4f82-9c29-44b6-becc-915728ec89d4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:08.746962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4f82-9c29-44b6-becc-915728ec89d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:08.764060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-515a4f82-9c29-44b6-becc-915728ec89d4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:08.765249 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-515a4f82-9c29-44b6-becc-915728ec89d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:08.830490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 553/1108] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:08 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:08.856072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35603fa-75dc-4f37-8bf9-543393a7e486 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:08.891709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:08.971298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35603fa-75dc-4f37-8bf9-543393a7e486 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:09.004343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9187123-3c49-478f-892d-9f667d1cc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:09.005061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9187123-3c49-478f-892d-9f667d1cc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:09.005347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9187123-3c49-478f-892d-9f667d1cc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:09.005625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9187123-3c49-478f-892d-9f667d1cc2e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:09.006786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9187123-3c49-478f-892d-9f667d1cc2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:09.008257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9187123-3c49-478f-892d-9f667d1cc2e6 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:09.010867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 556/1109] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:15:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:09.016675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4f82-9c29-44b6-becc-915728ec89d4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:09.019786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:09.111731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4f82-9c29-44b6-becc-915728ec89d4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:09.144886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1fdf0-17e0-4e2b-802f-711e3b062b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:09.145540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1fdf0-17e0-4e2b-802f-711e3b062b1b None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:09.145825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1fdf0-17e0-4e2b-802f-711e3b062b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:09.146104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1fdf0-17e0-4e2b-802f-711e3b062b1b None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:09.146821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1fdf0-17e0-4e2b-802f-711e3b062b1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:09.148334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1fdf0-17e0-4e2b-802f-711e3b062b1b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:09.168286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 554/1110] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:15:09 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:15:11.450982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dac6f-eeba-40de-b3a2-a3f253e9a347 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:11.451511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dac6f-eeba-40de-b3a2-a3f253e9a347 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:11.451511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dac6f-eeba-40de-b3a2-a3f253e9a347 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:11.452855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 557/1111] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:11.458062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab0534-261f-4659-9201-2eff862228f7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:11.458484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab0534-261f-4659-9201-2eff862228f7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:11.458628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab0534-261f-4659-9201-2eff862228f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:11.475045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3cab0534-261f-4659-9201-2eff862228f7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:11.476261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3cab0534-261f-4659-9201-2eff862228f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:11.532830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:11.544996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 555/1112] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:11 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:11.569563 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dac6f-eeba-40de-b3a2-a3f253e9a347 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:11.669003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dac6f-eeba-40de-b3a2-a3f253e9a347 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:11.671285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:11.702406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d5021-163c-4c51-8090-05eede615f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:11.703185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d5021-163c-4c51-8090-05eede615f8d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:11.703466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d5021-163c-4c51-8090-05eede615f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:11.703769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d5021-163c-4c51-8090-05eede615f8d None admin] PATH_INFO: `/v3/roles/45adf513980e4f8a9eab6f81b4fd8b77` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:11.705239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d5021-163c-4c51-8090-05eede615f8d None admin] RBAC: Authorizing `identity:get_role(role_id=45adf513980e4f8a9eab6f81b4fd8b77)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:11.706614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d5021-163c-4c51-8090-05eede615f8d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:11.708022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 558/1113] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:11 2022] GET /identity/v3/roles/45adf513980e4f8a9eab6f81b4fd8b77 => generated 224 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:11.713870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab0534-261f-4659-9201-2eff862228f7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:11.808432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab0534-261f-4659-9201-2eff862228f7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:11.840142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb931db-02d7-48ab-9485-d24c8bb62128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:11.840983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb931db-02d7-48ab-9485-d24c8bb62128 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:11.841264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb931db-02d7-48ab-9485-d24c8bb62128 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:11.841542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb931db-02d7-48ab-9485-d24c8bb62128 None admin] PATH_INFO: `/v3/users/6a9c2fe8f412459093fdee944f749f9e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:11.855334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb931db-02d7-48ab-9485-d24c8bb62128 None admin] RBAC: Authorizing `identity:get_user(user_id=6a9c2fe8f412459093fdee944f749f9e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:11.857059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb931db-02d7-48ab-9485-d24c8bb62128 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:11.858671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 556/1114] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:11 2022] GET /identity/v3/users/6a9c2fe8f412459093fdee944f749f9e => generated 287 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:11.864341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d5021-163c-4c51-8090-05eede615f8d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:11.964863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d5021-163c-4c51-8090-05eede615f8d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:11.998109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c6193-5f92-41eb-936e-13f8790ba267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:11.998752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c6193-5f92-41eb-936e-13f8790ba267 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:11.999035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c6193-5f92-41eb-936e-13f8790ba267 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:11.999312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c6193-5f92-41eb-936e-13f8790ba267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:12.039568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:12.066338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c6193-5f92-41eb-936e-13f8790ba267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:12.067839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c6193-5f92-41eb-936e-13f8790ba267 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:12.164141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 559/1115] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:15:11 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:15:12.169969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb931db-02d7-48ab-9485-d24c8bb62128 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:12.217993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:12.267982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb931db-02d7-48ab-9485-d24c8bb62128 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:12.299731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547add-710e-4e90-9365-3b70d35be24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:12.300571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547add-710e-4e90-9365-3b70d35be24e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:12.300845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547add-710e-4e90-9365-3b70d35be24e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:12.301112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547add-710e-4e90-9365-3b70d35be24e None admin] PATH_INFO: `/v3/projects/35629d8f7b9d4d52843cb01f0d390fec` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:12.302289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e547add-710e-4e90-9365-3b70d35be24e None admin] RBAC: Authorizing `identity:get_project(project_id=35629d8f7b9d4d52843cb01f0d390fec)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:12.303730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e547add-710e-4e90-9365-3b70d35be24e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:12.305411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 557/1116] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:12 2022] GET /identity/v3/projects/35629d8f7b9d4d52843cb01f0d390fec => generated 312 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:12.312084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c6193-5f92-41eb-936e-13f8790ba267 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:12.382413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:12.411536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c6193-5f92-41eb-936e-13f8790ba267 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:12.445180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a15b4-1a5e-497f-adab-fc8c98169558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:12.445834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a15b4-1a5e-497f-adab-fc8c98169558 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:12.446121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a15b4-1a5e-497f-adab-fc8c98169558 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:12.446401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a15b4-1a5e-497f-adab-fc8c98169558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:12.447257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a15b4-1a5e-497f-adab-fc8c98169558 None admin] RBAC: Adding query filter params (role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=35629d8f7b9d4d52843cb01f0d390fec, user.id=6a9c2fe8f412459093fdee944f749f9e) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:12.447590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a15b4-1a5e-497f-adab-fc8c98169558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:12.449026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a15b4-1a5e-497f-adab-fc8c98169558 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:12.455852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 560/1117] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:15:12 2022] GET /identity/v3/role_assignments?user.id=6a9c2fe8f412459093fdee944f749f9e&scope.project.id=35629d8f7b9d4d52843cb01f0d390fec&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 260 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:14.684630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecdd5-4763-4624-9446-5098300fb3ad None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:14.685166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecdd5-4763-4624-9446-5098300fb3ad None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:14.685166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecdd5-4763-4624-9446-5098300fb3ad None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:14.686542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 558/1118] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:14.691716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6469fc-9c25-4643-80a7-167365af3730 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:14.692161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6469fc-9c25-4643-80a7-167365af3730 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:14.692273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6469fc-9c25-4643-80a7-167365af3730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:14.708440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-cd6469fc-9c25-4643-80a7-167365af3730 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:14.709618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-cd6469fc-9c25-4643-80a7-167365af3730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:14.773841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 561/1119] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:14 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:14.796962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecdd5-4763-4624-9446-5098300fb3ad None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:14.895490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecdd5-4763-4624-9446-5098300fb3ad None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:14.911235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:14.929014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c61ac-a67d-41de-96e8-66684de75f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:14.929859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c61ac-a67d-41de-96e8-66684de75f4f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:14.930142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c61ac-a67d-41de-96e8-66684de75f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:14.930414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c61ac-a67d-41de-96e8-66684de75f4f None admin] PATH_INFO: `/v3/roles/45adf513980e4f8a9eab6f81b4fd8b77` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:14.932520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c61ac-a67d-41de-96e8-66684de75f4f None admin] RBAC: Authorizing `identity:get_role(role_id=45adf513980e4f8a9eab6f81b4fd8b77)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:14.933876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c61ac-a67d-41de-96e8-66684de75f4f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:14.935281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 559/1120] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:14 2022] GET /identity/v3/roles/45adf513980e4f8a9eab6f81b4fd8b77 => generated 224 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:14.941085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6469fc-9c25-4643-80a7-167365af3730 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:15.003127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:15.036526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6469fc-9c25-4643-80a7-167365af3730 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:15.070140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0653-0ecf-4c58-87f0-baa89a6c5b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:15.070997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0653-0ecf-4c58-87f0-baa89a6c5b2a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:15.071277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0653-0ecf-4c58-87f0-baa89a6c5b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:15.071604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0653-0ecf-4c58-87f0-baa89a6c5b2a None admin] PATH_INFO: `/v3/users/6a9c2fe8f412459093fdee944f749f9e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:15.072769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0653-0ecf-4c58-87f0-baa89a6c5b2a None admin] RBAC: Authorizing `identity:get_user(user_id=6a9c2fe8f412459093fdee944f749f9e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:15.074198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0653-0ecf-4c58-87f0-baa89a6c5b2a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:15.075843 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 562/1121] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:14 2022] GET /identity/v3/users/6a9c2fe8f412459093fdee944f749f9e => generated 287 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:15.081773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c61ac-a67d-41de-96e8-66684de75f4f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:15.182533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c61ac-a67d-41de-96e8-66684de75f4f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:15.215380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7513d-9e27-43b7-85aa-2ae69de59af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:15.216184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7513d-9e27-43b7-85aa-2ae69de59af5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:15.216464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7513d-9e27-43b7-85aa-2ae69de59af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:15.216738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7513d-9e27-43b7-85aa-2ae69de59af5 None admin] PATH_INFO: `/v3/projects/35629d8f7b9d4d52843cb01f0d390fec` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:15.217921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7513d-9e27-43b7-85aa-2ae69de59af5 None admin] RBAC: Authorizing `identity:get_project(project_id=35629d8f7b9d4d52843cb01f0d390fec)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:15.219341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7513d-9e27-43b7-85aa-2ae69de59af5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:15.221412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 560/1122] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:15 2022] GET /identity/v3/projects/35629d8f7b9d4d52843cb01f0d390fec => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:15.227512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0653-0ecf-4c58-87f0-baa89a6c5b2a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:15.325433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0653-0ecf-4c58-87f0-baa89a6c5b2a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:15.359480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c51ca-8b9c-4ed0-b547-14350a3b37b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:15.360389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c51ca-8b9c-4ed0-b547-14350a3b37b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:15.360673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c51ca-8b9c-4ed0-b547-14350a3b37b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:15.360951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c51ca-8b9c-4ed0-b547-14350a3b37b7 None admin] PATH_INFO: `/v3/projects/35629d8f7b9d4d52843cb01f0d390fec/users/6a9c2fe8f412459093fdee944f749f9e/roles/45adf513980e4f8a9eab6f81b4fd8b77` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:15.363140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c51ca-8b9c-4ed0-b547-14350a3b37b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=35629d8f7b9d4d52843cb01f0d390fec, user_id=6a9c2fe8f412459093fdee944f749f9e, role_id=45adf513980e4f8a9eab6f81b4fd8b77)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:15.364632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c51ca-8b9c-4ed0-b547-14350a3b37b7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:15.366823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:15.378388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 563/1123] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:15:15 2022] PUT /identity/v3/projects/35629d8f7b9d4d52843cb01f0d390fec/users/6a9c2fe8f412459093fdee944f749f9e/roles/45adf513980e4f8a9eab6f81b4fd8b77 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:15:17.611292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b9ee-297d-490a-b6fe-196133fe465c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:17.611868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b9ee-297d-490a-b6fe-196133fe465c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:17.611868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b9ee-297d-490a-b6fe-196133fe465c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:17.613167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 561/1124] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:17.618618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc026-cfe8-46d4-875f-27ad5e05e4c4 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:17.619033 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc026-cfe8-46d4-875f-27ad5e05e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:17.619172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebc026-cfe8-46d4-875f-27ad5e05e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:17.636324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f8ebc026-cfe8-46d4-875f-27ad5e05e4c4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:17.637515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f8ebc026-cfe8-46d4-875f-27ad5e05e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:17.705527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 564/1125] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:17 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:17.738958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653b9ee-297d-490a-b6fe-196133fe465c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:17.794686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:17.841889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653b9ee-297d-490a-b6fe-196133fe465c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:17.874347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3451-9104-417e-a951-241daaf73f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:17.875194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3451-9104-417e-a951-241daaf73f83 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:17.875478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3451-9104-417e-a951-241daaf73f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:17.875782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac3451-9104-417e-a951-241daaf73f83 None admin] PATH_INFO: `/v3/roles/45adf513980e4f8a9eab6f81b4fd8b77` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:17.877262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac3451-9104-417e-a951-241daaf73f83 None admin] RBAC: Authorizing `identity:get_role(role_id=45adf513980e4f8a9eab6f81b4fd8b77)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:17.878627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac3451-9104-417e-a951-241daaf73f83 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:17.880033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 562/1126] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:17 2022] GET /identity/v3/roles/45adf513980e4f8a9eab6f81b4fd8b77 => generated 224 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:17.886429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc026-cfe8-46d4-875f-27ad5e05e4c4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:17.983353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebc026-cfe8-46d4-875f-27ad5e05e4c4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:18.005984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:18.017396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b99ef3-c976-4fd1-a379-98aa18696c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:18.018248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b99ef3-c976-4fd1-a379-98aa18696c42 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:18.018529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b99ef3-c976-4fd1-a379-98aa18696c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:18.018798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b99ef3-c976-4fd1-a379-98aa18696c42 None admin] PATH_INFO: `/v3/users/6a9c2fe8f412459093fdee944f749f9e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:18.019995 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b99ef3-c976-4fd1-a379-98aa18696c42 None admin] RBAC: Authorizing `identity:get_user(user_id=6a9c2fe8f412459093fdee944f749f9e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:18.021434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b99ef3-c976-4fd1-a379-98aa18696c42 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:18.023038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 565/1127] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:17 2022] GET /identity/v3/users/6a9c2fe8f412459093fdee944f749f9e => generated 287 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:18.028819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3451-9104-417e-a951-241daaf73f83 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:18.127539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac3451-9104-417e-a951-241daaf73f83 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:18.147011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:18.160923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868a2e-4cc6-4145-b709-91c266372483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:18.161561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868a2e-4cc6-4145-b709-91c266372483 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:18.161839 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868a2e-4cc6-4145-b709-91c266372483 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:18.162136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868a2e-4cc6-4145-b709-91c266372483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:18.228996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868a2e-4cc6-4145-b709-91c266372483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:18.237094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868a2e-4cc6-4145-b709-91c266372483 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:18.332785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 563/1128] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:15:18 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:15:18.339220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b99ef3-c976-4fd1-a379-98aa18696c42 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:18.436987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b99ef3-c976-4fd1-a379-98aa18696c42 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:18.470183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed5bc8-e8de-4695-8daf-1f7d7a746ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:18.471036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5bc8-e8de-4695-8daf-1f7d7a746ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:18.471321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5bc8-e8de-4695-8daf-1f7d7a746ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:18.471626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5bc8-e8de-4695-8daf-1f7d7a746ce7 None admin] PATH_INFO: `/v3/projects/35629d8f7b9d4d52843cb01f0d390fec` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:18.472800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed5bc8-e8de-4695-8daf-1f7d7a746ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=35629d8f7b9d4d52843cb01f0d390fec)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:18.474464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed5bc8-e8de-4695-8daf-1f7d7a746ce7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:18.476186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 566/1129] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:18 2022] GET /identity/v3/projects/35629d8f7b9d4d52843cb01f0d390fec => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:18.482571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868a2e-4cc6-4145-b709-91c266372483 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:18.502830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:18.578451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868a2e-4cc6-4145-b709-91c266372483 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:18.611561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b8f4-420a-4444-9fab-45078bcf1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:18.612219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b8f4-420a-4444-9fab-45078bcf1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:18.612503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b8f4-420a-4444-9fab-45078bcf1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:18.612778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b8f4-420a-4444-9fab-45078bcf1bb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:18.613597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b8f4-420a-4444-9fab-45078bcf1bb8 None admin] RBAC: Adding query filter params (role.id=45adf513980e4f8a9eab6f81b4fd8b77, scope.project.id=35629d8f7b9d4d52843cb01f0d390fec, user.id=6a9c2fe8f412459093fdee944f749f9e) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:18.613907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b8f4-420a-4444-9fab-45078bcf1bb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:18.615329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b8f4-420a-4444-9fab-45078bcf1bb8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:18.621593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 564/1130] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:15:18 2022] GET /identity/v3/role_assignments?user.id=6a9c2fe8f412459093fdee944f749f9e&scope.project.id=35629d8f7b9d4d52843cb01f0d390fec&role.id=45adf513980e4f8a9eab6f81b4fd8b77 => generated 610 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:20.884108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc917319-7d7b-4f05-a482-20e3aac0a101 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:20.884651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc917319-7d7b-4f05-a482-20e3aac0a101 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:20.884651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc917319-7d7b-4f05-a482-20e3aac0a101 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:20.886032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 567/1131] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:20.891254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbe880-0012-4bbf-a6c1-2e26bdd95e6d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:20.891721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbe880-0012-4bbf-a6c1-2e26bdd95e6d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:20.891814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbe880-0012-4bbf-a6c1-2e26bdd95e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:20.908445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bfcbe880-0012-4bbf-a6c1-2e26bdd95e6d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:20.909653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bfcbe880-0012-4bbf-a6c1-2e26bdd95e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:20.976495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 565/1132] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:20 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:21.001028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc917319-7d7b-4f05-a482-20e3aac0a101 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:21.060728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:21.101029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc917319-7d7b-4f05-a482-20e3aac0a101 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:21.134857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603ef1d-d460-427b-9599-2e3cf62415b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:21.135637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603ef1d-d460-427b-9599-2e3cf62415b7 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:21.135868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603ef1d-d460-427b-9599-2e3cf62415b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:21.136139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603ef1d-d460-427b-9599-2e3cf62415b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:21.138262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603ef1d-d460-427b-9599-2e3cf62415b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:21.139723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603ef1d-d460-427b-9599-2e3cf62415b7 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:21.141324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 568/1133] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:15:21 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:21.147172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbe880-0012-4bbf-a6c1-2e26bdd95e6d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:21.162572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:21.245958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbe880-0012-4bbf-a6c1-2e26bdd95e6d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:21.278702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efeb3c-8e8c-4a43-9940-860b03b74b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:21.279351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efeb3c-8e8c-4a43-9940-860b03b74b89 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:21.279662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efeb3c-8e8c-4a43-9940-860b03b74b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:21.279936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efeb3c-8e8c-4a43-9940-860b03b74b89 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:21.280642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efeb3c-8e8c-4a43-9940-860b03b74b89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:21.282069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efeb3c-8e8c-4a43-9940-860b03b74b89 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:21.307218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 566/1134] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:15:21 2022] POST /identity/v3/projects => generated 312 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:15:23.568902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a2a3-cae2-470b-bd3a-1f9801c78789 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:23.569442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a2a3-cae2-470b-bd3a-1f9801c78789 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:23.569442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a2a3-cae2-470b-bd3a-1f9801c78789 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:23.570765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 569/1135] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:23.576674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b2210-33e1-413e-a230-c1e6dce4fe4f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:23.577737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b2210-33e1-413e-a230-c1e6dce4fe4f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:23.577737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b2210-33e1-413e-a230-c1e6dce4fe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:23.594682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-eb4b2210-33e1-413e-a230-c1e6dce4fe4f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:23.595917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eb4b2210-33e1-413e-a230-c1e6dce4fe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:23.657498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:23.666299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 567/1136] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:23 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:23.690760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0a2a3-cae2-470b-bd3a-1f9801c78789 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:23.799403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0a2a3-cae2-470b-bd3a-1f9801c78789 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:23.827068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:23.835393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e225586-4902-4f1b-9979-484e5dc51595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:23.836213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e225586-4902-4f1b-9979-484e5dc51595 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:23.836505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e225586-4902-4f1b-9979-484e5dc51595 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:23.837347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e225586-4902-4f1b-9979-484e5dc51595 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:23.838527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e225586-4902-4f1b-9979-484e5dc51595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:23.840002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e225586-4902-4f1b-9979-484e5dc51595 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:23.841628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 570/1137] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:15:23 2022] GET /identity/v3/domains/default => generated 200 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:23.847570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b2210-33e1-413e-a230-c1e6dce4fe4f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:23.945757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b2210-33e1-413e-a230-c1e6dce4fe4f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:23.979446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad964b2-1ca0-460f-a566-dcaff73c4c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:23.980122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad964b2-1ca0-460f-a566-dcaff73c4c83 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:23.980655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad964b2-1ca0-460f-a566-dcaff73c4c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:23.980926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad964b2-1ca0-460f-a566-dcaff73c4c83 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:23.981640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad964b2-1ca0-460f-a566-dcaff73c4c83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:23.983080 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad964b2-1ca0-460f-a566-dcaff73c4c83 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:24.003475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 568/1138] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:15:23 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:15:26.349266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f6bd-e33a-4168-bdd3-f4467b3ecf63 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:26.349856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f6bd-e33a-4168-bdd3-f4467b3ecf63 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:26.349856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f6bd-e33a-4168-bdd3-f4467b3ecf63 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:26.351180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 571/1139] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:26.357400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20dbd9-bf2d-4d75-8a00-6ee5b4c95b68 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:26.357825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20dbd9-bf2d-4d75-8a00-6ee5b4c95b68 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:26.357964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20dbd9-bf2d-4d75-8a00-6ee5b4c95b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:26.375218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ce20dbd9-bf2d-4d75-8a00-6ee5b4c95b68 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:26.376439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ce20dbd9-bf2d-4d75-8a00-6ee5b4c95b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:26.422946 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:26.442723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 569/1140] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:26 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:26.466924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9f6bd-e33a-4168-bdd3-f4467b3ecf63 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:26.565664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9f6bd-e33a-4168-bdd3-f4467b3ecf63 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:26.598798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c596bc-3265-4049-96c3-cc3a2b1786bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:26.599614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c596bc-3265-4049-96c3-cc3a2b1786bd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:26.599902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c596bc-3265-4049-96c3-cc3a2b1786bd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:26.600179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c596bc-3265-4049-96c3-cc3a2b1786bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:26.611746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c596bc-3265-4049-96c3-cc3a2b1786bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-31c596bc-3265-4049-96c3-cc3a2b1786bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:15:26.619431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:26.620669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:15:26.621629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 572/1141] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:26.626823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20dbd9-bf2d-4d75-8a00-6ee5b4c95b68 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:26.726426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20dbd9-bf2d-4d75-8a00-6ee5b4c95b68 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:26.760688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ea0bf-73e6-41a4-a0b4-48b2590662af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:26.761351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ea0bf-73e6-41a4-a0b4-48b2590662af None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:26.761635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ea0bf-73e6-41a4-a0b4-48b2590662af None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:26.761913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ea0bf-73e6-41a4-a0b4-48b2590662af None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:26.762661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ea0bf-73e6-41a4-a0b4-48b2590662af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:26.762967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ea0bf-73e6-41a4-a0b4-48b2590662af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:26.764372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ea0bf-73e6-41a4-a0b4-48b2590662af None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:26.772495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 570/1142] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:15:26 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:26.778958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c596bc-3265-4049-96c3-cc3a2b1786bd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:26.833469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:26.877634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c596bc-3265-4049-96c3-cc3a2b1786bd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:26.911105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df7f2-2328-42b8-8273-6718c20fec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:26.911993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df7f2-2328-42b8-8273-6718c20fec2a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:26.912280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df7f2-2328-42b8-8273-6718c20fec2a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:26.912560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df7f2-2328-42b8-8273-6718c20fec2a None admin] PATH_INFO: `/v3/users/e686a9e74a744acf8613b41d714e4975` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:26.928339 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4df7f2-2328-42b8-8273-6718c20fec2a None admin] RBAC: Authorizing `identity:get_user(user_id=e686a9e74a744acf8613b41d714e4975)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:26.929815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4df7f2-2328-42b8-8273-6718c20fec2a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:26.931615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 573/1143] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:26 2022] GET /identity/v3/users/e686a9e74a744acf8613b41d714e4975 => generated 287 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:26.937480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ea0bf-73e6-41a4-a0b4-48b2590662af None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:26.984405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:27.041741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ea0bf-73e6-41a4-a0b4-48b2590662af None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:27.075419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0647f7d-9ab3-4d12-9ba9-4747cf7d5556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:27.076083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0647f7d-9ab3-4d12-9ba9-4747cf7d5556 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:27.076370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0647f7d-9ab3-4d12-9ba9-4747cf7d5556 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:27.076651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0647f7d-9ab3-4d12-9ba9-4747cf7d5556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:27.141806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0647f7d-9ab3-4d12-9ba9-4747cf7d5556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:27.143257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0647f7d-9ab3-4d12-9ba9-4747cf7d5556 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:27.186332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:27.240741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 571/1144] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:15:26 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 16:15:27.247137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df7f2-2328-42b8-8273-6718c20fec2a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:27.353468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df7f2-2328-42b8-8273-6718c20fec2a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:27.367229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:27.388073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e1978-c93f-4c76-b05f-18a2275e091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:27.388924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1978-c93f-4c76-b05f-18a2275e091d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:27.389205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1978-c93f-4c76-b05f-18a2275e091d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:27.389477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1978-c93f-4c76-b05f-18a2275e091d None admin] PATH_INFO: `/v3/projects/11ff501ca1d54618898c243679d3e89a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:27.390638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e1978-c93f-4c76-b05f-18a2275e091d None admin] RBAC: Authorizing `identity:get_project(project_id=11ff501ca1d54618898c243679d3e89a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:27.392119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e1978-c93f-4c76-b05f-18a2275e091d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:27.393805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 574/1145] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:27 2022] GET /identity/v3/projects/11ff501ca1d54618898c243679d3e89a => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:27.400693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0647f7d-9ab3-4d12-9ba9-4747cf7d5556 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:27.494665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0647f7d-9ab3-4d12-9ba9-4747cf7d5556 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:27.527721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed36705-7eb5-40c5-90eb-1785354eb29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:27.528361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36705-7eb5-40c5-90eb-1785354eb29e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:27.528643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36705-7eb5-40c5-90eb-1785354eb29e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:27.528919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36705-7eb5-40c5-90eb-1785354eb29e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:27.529747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed36705-7eb5-40c5-90eb-1785354eb29e None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=11ff501ca1d54618898c243679d3e89a, user.id=e686a9e74a744acf8613b41d714e4975) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:27.530060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed36705-7eb5-40c5-90eb-1785354eb29e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:27.531490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed36705-7eb5-40c5-90eb-1785354eb29e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:27.537041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 572/1146] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:15:27 2022] GET /identity/v3/role_assignments?user.id=e686a9e74a744acf8613b41d714e4975&scope.project.id=11ff501ca1d54618898c243679d3e89a&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 260 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:29.781206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc812c-68f5-4d58-b18a-eb11dc8d018c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:29.781771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc812c-68f5-4d58-b18a-eb11dc8d018c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:29.781771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc812c-68f5-4d58-b18a-eb11dc8d018c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:29.783135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 575/1147] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:29.788666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acf769-59a4-48c4-b4ab-5d4a4e0a62a7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:29.789099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acf769-59a4-48c4-b4ab-5d4a4e0a62a7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:29.789223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acf769-59a4-48c4-b4ab-5d4a4e0a62a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:29.806901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b2acf769-59a4-48c4-b4ab-5d4a4e0a62a7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:29.808124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b2acf769-59a4-48c4-b4ab-5d4a4e0a62a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:29.810174 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:29.877474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 573/1148] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:29 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:29.900067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc812c-68f5-4d58-b18a-eb11dc8d018c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:30.005787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc812c-68f5-4d58-b18a-eb11dc8d018c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:30.042162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785a3f9-521e-4567-a2a0-95877a7d094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:30.042865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a3f9-521e-4567-a2a0-95877a7d094c None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:30.043148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a3f9-521e-4567-a2a0-95877a7d094c None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:30.043426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785a3f9-521e-4567-a2a0-95877a7d094c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:30.057110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785a3f9-521e-4567-a2a0-95877a7d094c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c785a3f9-521e-4567-a2a0-95877a7d094c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:15:30.065191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:30.066422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:15:30.067392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 576/1149] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:30.073373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acf769-59a4-48c4-b4ab-5d4a4e0a62a7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:30.174157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acf769-59a4-48c4-b4ab-5d4a4e0a62a7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:30.209637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c2943-b7a5-4821-a9cf-630e2c68541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:30.210310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c2943-b7a5-4821-a9cf-630e2c68541a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:30.210585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c2943-b7a5-4821-a9cf-630e2c68541a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:30.210856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c2943-b7a5-4821-a9cf-630e2c68541a None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:30.211671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c2943-b7a5-4821-a9cf-630e2c68541a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:30.211977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c2943-b7a5-4821-a9cf-630e2c68541a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:30.213388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c2943-b7a5-4821-a9cf-630e2c68541a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:30.219385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:30.223357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 574/1150] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:15:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:30.232515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785a3f9-521e-4567-a2a0-95877a7d094c None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:30.278838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:30.344569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785a3f9-521e-4567-a2a0-95877a7d094c None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:30.381870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2199eb-0a41-4d99-b2b7-34a8a448bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:30.382736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2199eb-0a41-4d99-b2b7-34a8a448bea5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:30.383016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2199eb-0a41-4d99-b2b7-34a8a448bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:30.383307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2199eb-0a41-4d99-b2b7-34a8a448bea5 None admin] PATH_INFO: `/v3/users/e686a9e74a744acf8613b41d714e4975` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:30.384534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2199eb-0a41-4d99-b2b7-34a8a448bea5 None admin] RBAC: Authorizing `identity:get_user(user_id=e686a9e74a744acf8613b41d714e4975)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:30.385972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2199eb-0a41-4d99-b2b7-34a8a448bea5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:30.387631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 577/1151] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:30 2022] GET /identity/v3/users/e686a9e74a744acf8613b41d714e4975 => generated 287 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:30.393480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c2943-b7a5-4821-a9cf-630e2c68541a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:30.494228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c2943-b7a5-4821-a9cf-630e2c68541a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:30.527423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331ed9d-0528-422b-9a22-7370eff4eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:30.528312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331ed9d-0528-422b-9a22-7370eff4eec3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:30.528595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331ed9d-0528-422b-9a22-7370eff4eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:30.528870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331ed9d-0528-422b-9a22-7370eff4eec3 None admin] PATH_INFO: `/v3/projects/11ff501ca1d54618898c243679d3e89a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:30.530042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331ed9d-0528-422b-9a22-7370eff4eec3 None admin] RBAC: Authorizing `identity:get_project(project_id=11ff501ca1d54618898c243679d3e89a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:30.531470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331ed9d-0528-422b-9a22-7370eff4eec3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:30.533187 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 575/1152] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:30 2022] GET /identity/v3/projects/11ff501ca1d54618898c243679d3e89a => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:30.540054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2199eb-0a41-4d99-b2b7-34a8a448bea5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:30.642618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2199eb-0a41-4d99-b2b7-34a8a448bea5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:30.653037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:30.676630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406f1d0-46a1-4184-ba1a-bc3a7f0a0eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:30.677521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f1d0-46a1-4184-ba1a-bc3a7f0a0eaf None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:30.677805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f1d0-46a1-4184-ba1a-bc3a7f0a0eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:30.678081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f1d0-46a1-4184-ba1a-bc3a7f0a0eaf None admin] PATH_INFO: `/v3/projects/11ff501ca1d54618898c243679d3e89a/users/e686a9e74a744acf8613b41d714e4975/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:30.680110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406f1d0-46a1-4184-ba1a-bc3a7f0a0eaf None admin] RBAC: Authorizing `identity:create_grant(project_id=11ff501ca1d54618898c243679d3e89a, user_id=e686a9e74a744acf8613b41d714e4975, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:30.682051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406f1d0-46a1-4184-ba1a-bc3a7f0a0eaf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:30.694385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 578/1153] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:15:30 2022] PUT /identity/v3/projects/11ff501ca1d54618898c243679d3e89a/users/e686a9e74a744acf8613b41d714e4975/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:15:32.906600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e9d4-1c90-4534-9ee3-72d7096e465d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:32.907243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e9d4-1c90-4534-9ee3-72d7096e465d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:32.907243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70e9d4-1c90-4534-9ee3-72d7096e465d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:32.908548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 576/1154] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:15:32.913873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0363f7-1718-49b5-9c59-7b4271cebe77 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:32.914253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0363f7-1718-49b5-9c59-7b4271cebe77 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:32.914443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0363f7-1718-49b5-9c59-7b4271cebe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:32.932109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1b0363f7-1718-49b5-9c59-7b4271cebe77 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:32.933302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1b0363f7-1718-49b5-9c59-7b4271cebe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:33.000046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 579/1155] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:32 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:15:33.023485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e9d4-1c90-4534-9ee3-72d7096e465d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:33.089954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:33.123330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70e9d4-1c90-4534-9ee3-72d7096e465d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:33.157305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716ab87-4414-402b-8243-03e435fc44bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:33.158022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716ab87-4414-402b-8243-03e435fc44bf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:33.158305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716ab87-4414-402b-8243-03e435fc44bf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:33.158580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716ab87-4414-402b-8243-03e435fc44bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:33.169678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716ab87-4414-402b-8243-03e435fc44bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e716ab87-4414-402b-8243-03e435fc44bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:15:33.177531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:33.178670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:33.179766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 577/1156] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:33.184825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0363f7-1718-49b5-9c59-7b4271cebe77 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:33.281086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:33.284440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0363f7-1718-49b5-9c59-7b4271cebe77 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:33.325527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d077681-44a6-49ea-882f-35db89a56eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:33.326194 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d077681-44a6-49ea-882f-35db89a56eeb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:33.326459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d077681-44a6-49ea-882f-35db89a56eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:33.326733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d077681-44a6-49ea-882f-35db89a56eeb None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:33.327480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d077681-44a6-49ea-882f-35db89a56eeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:33.327813 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d077681-44a6-49ea-882f-35db89a56eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:33.329196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d077681-44a6-49ea-882f-35db89a56eeb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:33.337709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 580/1157] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:15:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:33.343523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716ab87-4414-402b-8243-03e435fc44bf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:33.440480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716ab87-4414-402b-8243-03e435fc44bf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:33.465561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:33.473742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b56279-50ae-4830-8e4d-9889a36fcca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:33.474608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b56279-50ae-4830-8e4d-9889a36fcca5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:33.474891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b56279-50ae-4830-8e4d-9889a36fcca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:33.475168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b56279-50ae-4830-8e4d-9889a36fcca5 None admin] PATH_INFO: `/v3/users/e686a9e74a744acf8613b41d714e4975` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:33.476388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b56279-50ae-4830-8e4d-9889a36fcca5 None admin] RBAC: Authorizing `identity:get_user(user_id=e686a9e74a744acf8613b41d714e4975)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:33.477892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b56279-50ae-4830-8e4d-9889a36fcca5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:33.479523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 578/1158] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:33 2022] GET /identity/v3/users/e686a9e74a744acf8613b41d714e4975 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:33.485586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d077681-44a6-49ea-882f-35db89a56eeb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:33.583474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d077681-44a6-49ea-882f-35db89a56eeb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:33.616894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a383e0-4810-45a6-80fd-a3a803351b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:33.618073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a383e0-4810-45a6-80fd-a3a803351b24 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:33.618355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a383e0-4810-45a6-80fd-a3a803351b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:33.618629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a383e0-4810-45a6-80fd-a3a803351b24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:33.648018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:33.685073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a383e0-4810-45a6-80fd-a3a803351b24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:33.686528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a383e0-4810-45a6-80fd-a3a803351b24 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:33.784502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 581/1159] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:15:33 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:15:33.791006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b56279-50ae-4830-8e4d-9889a36fcca5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:33.891365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b56279-50ae-4830-8e4d-9889a36fcca5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:33.927118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97142c0c-25c5-49a4-8367-0a30801903eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:33.928673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142c0c-25c5-49a4-8367-0a30801903eb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:33.929202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142c0c-25c5-49a4-8367-0a30801903eb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:33.929720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142c0c-25c5-49a4-8367-0a30801903eb None admin] PATH_INFO: `/v3/projects/11ff501ca1d54618898c243679d3e89a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:33.932474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97142c0c-25c5-49a4-8367-0a30801903eb None admin] RBAC: Authorizing `identity:get_project(project_id=11ff501ca1d54618898c243679d3e89a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:33.935227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97142c0c-25c5-49a4-8367-0a30801903eb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:33.938495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 579/1160] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:33 2022] GET /identity/v3/projects/11ff501ca1d54618898c243679d3e89a => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:33.944707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a383e0-4810-45a6-80fd-a3a803351b24 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:34.004099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:34.042565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a383e0-4810-45a6-80fd-a3a803351b24 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:34.076027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72eceb-af12-43fc-8634-876682b63b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:34.076673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72eceb-af12-43fc-8634-876682b63b76 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:34.076956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72eceb-af12-43fc-8634-876682b63b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:34.077236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72eceb-af12-43fc-8634-876682b63b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:34.078054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72eceb-af12-43fc-8634-876682b63b76 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=11ff501ca1d54618898c243679d3e89a, user.id=e686a9e74a744acf8613b41d714e4975) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:34.078369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72eceb-af12-43fc-8634-876682b63b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:34.079815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72eceb-af12-43fc-8634-876682b63b76 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:34.085630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 582/1161] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:15:33 2022] GET /identity/v3/role_assignments?user.id=e686a9e74a744acf8613b41d714e4975&scope.project.id=11ff501ca1d54618898c243679d3e89a&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:36.362783 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824937-d6de-4c0a-92fc-aadb7862468d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:36.363341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824937-d6de-4c0a-92fc-aadb7862468d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:36.363341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824937-d6de-4c0a-92fc-aadb7862468d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:36.364754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 580/1162] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:36.370560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad615e-3f53-4d87-a027-dd3aee8ec791 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:36.370957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad615e-3f53-4d87-a027-dd3aee8ec791 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:36.371217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad615e-3f53-4d87-a027-dd3aee8ec791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:36.387763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-cdad615e-3f53-4d87-a027-dd3aee8ec791 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:36.388954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-cdad615e-3f53-4d87-a027-dd3aee8ec791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:36.454532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 583/1163] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:36 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:36.478378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01824937-d6de-4c0a-92fc-aadb7862468d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:36.540636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:36.577359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01824937-d6de-4c0a-92fc-aadb7862468d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:36.610609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8618d-c31b-4860-9b63-96748304ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:36.611230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8618d-c31b-4860-9b63-96748304ce4e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:36.611509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8618d-c31b-4860-9b63-96748304ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:36.611815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8618d-c31b-4860-9b63-96748304ce4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:36.677290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8618d-c31b-4860-9b63-96748304ce4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:36.678738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8618d-c31b-4860-9b63-96748304ce4e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:36.739169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:36.775971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 581/1164] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:15:36 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:15:36.782447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad615e-3f53-4d87-a027-dd3aee8ec791 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:36.837109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:36.879325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad615e-3f53-4d87-a027-dd3aee8ec791 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:36.912733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d8dc1-68ad-4b4f-a861-6403781c9b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:36.913513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d8dc1-68ad-4b4f-a861-6403781c9b80 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:36.913797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d8dc1-68ad-4b4f-a861-6403781c9b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:36.914102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d8dc1-68ad-4b4f-a861-6403781c9b80 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:36.920654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d8dc1-68ad-4b4f-a861-6403781c9b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:36.922103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d8dc1-68ad-4b4f-a861-6403781c9b80 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-278d8dc1-68ad-4b4f-a861-6403781c9b80 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:36.935998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:36.937213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:15:36.938132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 584/1165] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:15:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:36.943243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8618d-c31b-4860-9b63-96748304ce4e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:37.045616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8618d-c31b-4860-9b63-96748304ce4e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:37.079228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c3315-4f05-499b-ada3-71ffa3a5c45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:37.079910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c3315-4f05-499b-ada3-71ffa3a5c45b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:37.080197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c3315-4f05-499b-ada3-71ffa3a5c45b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:37.080478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c3315-4f05-499b-ada3-71ffa3a5c45b None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:37.081200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c3315-4f05-499b-ada3-71ffa3a5c45b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:37.081507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c3315-4f05-499b-ada3-71ffa3a5c45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:37.082878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c3315-4f05-499b-ada3-71ffa3a5c45b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:37.090470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 582/1166] 10.222.0.112 () {56 vars in 1120 bytes} [Fri Jun 3 16:15:36 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:39.327350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011138a-5ce3-4233-b899-6ae88f544527 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:39.327984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011138a-5ce3-4233-b899-6ae88f544527 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:39.327984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011138a-5ce3-4233-b899-6ae88f544527 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:39.329306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 585/1167] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:39.334644 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812afdf-4fff-444a-8173-d2c76baf3a7d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:39.335066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812afdf-4fff-444a-8173-d2c76baf3a7d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:39.335209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812afdf-4fff-444a-8173-d2c76baf3a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:39.352358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c812afdf-4fff-444a-8173-d2c76baf3a7d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:39.353542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c812afdf-4fff-444a-8173-d2c76baf3a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:39.376105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:39.426150 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 583/1168] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:39 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:39.450224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011138a-5ce3-4233-b899-6ae88f544527 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:39.549946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011138a-5ce3-4233-b899-6ae88f544527 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:39.565920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:39.586571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7715b2-af39-413e-affb-ddd054cca96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:39.587243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7715b2-af39-413e-affb-ddd054cca96a None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:39.587528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7715b2-af39-413e-affb-ddd054cca96a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:39.587840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7715b2-af39-413e-affb-ddd054cca96a None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:39.588583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7715b2-af39-413e-affb-ddd054cca96a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:39.589972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7715b2-af39-413e-affb-ddd054cca96a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:39.605315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 586/1169] 10.222.0.112 () {60 vars in 1143 bytes} [Fri Jun 3 16:15:39 2022] POST /identity/v3/domains => generated 268 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:15:41.910291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ce54d-a4fe-44c8-a0b6-28fa689f1748 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:41.910833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ce54d-a4fe-44c8-a0b6-28fa689f1748 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:41.910833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ce54d-a4fe-44c8-a0b6-28fa689f1748 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:41.912253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 584/1170] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:41.918157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dae63-060b-4bef-8c84-1f79b37a0223 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:41.918594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dae63-060b-4bef-8c84-1f79b37a0223 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:41.918721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dae63-060b-4bef-8c84-1f79b37a0223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:41.935198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-378dae63-060b-4bef-8c84-1f79b37a0223 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:41.936417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-378dae63-060b-4bef-8c84-1f79b37a0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:42.000420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 587/1171] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:41 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:42.031365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ce54d-a4fe-44c8-a0b6-28fa689f1748 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:42.137338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ce54d-a4fe-44c8-a0b6-28fa689f1748 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:42.171862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b670fc-6bdd-4f10-b1f4-76cf28d5dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:42.172649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b670fc-6bdd-4f10-b1f4-76cf28d5dc62 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:42.172933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b670fc-6bdd-4f10-b1f4-76cf28d5dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:42.173212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b670fc-6bdd-4f10-b1f4-76cf28d5dc62 None admin] PATH_INFO: `/v3/domains/62caeee7ce72483ea17fff21563aac61` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:42.184276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b670fc-6bdd-4f10-b1f4-76cf28d5dc62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=62caeee7ce72483ea17fff21563aac61)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:42.185778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b670fc-6bdd-4f10-b1f4-76cf28d5dc62 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:42.187503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 585/1172] 10.222.0.112 () {56 vars in 1188 bytes} [Fri Jun 3 16:15:42 2022] GET /identity/v3/domains/62caeee7ce72483ea17fff21563aac61 => generated 268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:42.193378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dae63-060b-4bef-8c84-1f79b37a0223 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:42.295102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dae63-060b-4bef-8c84-1f79b37a0223 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:42.302663 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:42.333188 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e2ab3-6013-4b9e-954b-8a75cfb06359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:42.334043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e2ab3-6013-4b9e-954b-8a75cfb06359 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:42.334455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e2ab3-6013-4b9e-954b-8a75cfb06359 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:42.334771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e2ab3-6013-4b9e-954b-8a75cfb06359 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:42.335468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e2ab3-6013-4b9e-954b-8a75cfb06359 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:42.336981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e2ab3-6013-4b9e-954b-8a75cfb06359 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:42.364729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 588/1173] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:15:42 2022] POST /identity/v3/projects => generated 362 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:15:44.646360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e30a-80e6-4278-b2cf-296c0702f72b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:44.646910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e30a-80e6-4278-b2cf-296c0702f72b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:44.646910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e30a-80e6-4278-b2cf-296c0702f72b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:44.648834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 586/1174] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:44.654085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7487dc-a847-42b0-9a80-74f555cfc99e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:44.654643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7487dc-a847-42b0-9a80-74f555cfc99e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:44.654643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7487dc-a847-42b0-9a80-74f555cfc99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:44.671618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9a7487dc-a847-42b0-9a80-74f555cfc99e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:44.672796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9a7487dc-a847-42b0-9a80-74f555cfc99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:44.737555 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 589/1175] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:44 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:15:44.762042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e30a-80e6-4278-b2cf-296c0702f72b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:44.782736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:44.864851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e30a-80e6-4278-b2cf-296c0702f72b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:44.896237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627dc65-55cf-4cd4-82de-e5d601e6c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:44.897123 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627dc65-55cf-4cd4-82de-e5d601e6c125 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:44.897349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627dc65-55cf-4cd4-82de-e5d601e6c125 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:44.897620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627dc65-55cf-4cd4-82de-e5d601e6c125 None admin] PATH_INFO: `/v3/domains/62caeee7ce72483ea17fff21563aac61` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:44.899309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627dc65-55cf-4cd4-82de-e5d601e6c125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=62caeee7ce72483ea17fff21563aac61)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:44.900772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627dc65-55cf-4cd4-82de-e5d601e6c125 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:44.902371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 587/1176] 10.222.0.112 () {56 vars in 1188 bytes} [Fri Jun 3 16:15:44 2022] GET /identity/v3/domains/62caeee7ce72483ea17fff21563aac61 => generated 268 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:44.908184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7487dc-a847-42b0-9a80-74f555cfc99e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:44.992927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:45.005705 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7487dc-a847-42b0-9a80-74f555cfc99e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:45.039171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc901d-ae5f-425c-a6e7-0e42df619cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:45.039873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc901d-ae5f-425c-a6e7-0e42df619cd5 None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:45.040159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc901d-ae5f-425c-a6e7-0e42df619cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:45.040441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc901d-ae5f-425c-a6e7-0e42df619cd5 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:45.041423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc901d-ae5f-425c-a6e7-0e42df619cd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:45.042863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc901d-ae5f-425c-a6e7-0e42df619cd5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:45.062394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 590/1177] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:15:44 2022] POST /identity/v3/users => generated 312 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:15:47.353450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170f201-873e-48aa-88ab-1f70742b3e29 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:47.353981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170f201-873e-48aa-88ab-1f70742b3e29 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:47.353981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170f201-873e-48aa-88ab-1f70742b3e29 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:47.355641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 588/1178] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:47.360974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a2a4-0a82-4bb2-a785-bbabcff9037b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:47.361414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a2a4-0a82-4bb2-a785-bbabcff9037b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:47.361539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a2a4-0a82-4bb2-a785-bbabcff9037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:47.378274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3205a2a4-0a82-4bb2-a785-bbabcff9037b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:47.379469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3205a2a4-0a82-4bb2-a785-bbabcff9037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:47.444636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 591/1179] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:47 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:47.469111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170f201-873e-48aa-88ab-1f70742b3e29 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:47.558440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:47.575267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170f201-873e-48aa-88ab-1f70742b3e29 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:47.612338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2463d4-5d9f-4d96-8f0a-0e54c9e84be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:47.613136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2463d4-5d9f-4d96-8f0a-0e54c9e84be4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:47.613414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2463d4-5d9f-4d96-8f0a-0e54c9e84be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:47.613697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2463d4-5d9f-4d96-8f0a-0e54c9e84be4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:47.623952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2463d4-5d9f-4d96-8f0a-0e54c9e84be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-af2463d4-5d9f-4d96-8f0a-0e54c9e84be4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:15:47.631540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:47.633260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:47.634434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 589/1180] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:47.640028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a2a4-0a82-4bb2-a785-bbabcff9037b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:47.717245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:47.742712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a2a4-0a82-4bb2-a785-bbabcff9037b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:47.776160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470da8-2416-4ea9-a4af-f701114c95dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:47.776826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470da8-2416-4ea9-a4af-f701114c95dc None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:47.777110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470da8-2416-4ea9-a4af-f701114c95dc None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:47.777392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470da8-2416-4ea9-a4af-f701114c95dc None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:47.778148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470da8-2416-4ea9-a4af-f701114c95dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:47.778455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470da8-2416-4ea9-a4af-f701114c95dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:47.779872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470da8-2416-4ea9-a4af-f701114c95dc None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:47.788297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 592/1181] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:15:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:47.794434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2463d4-5d9f-4d96-8f0a-0e54c9e84be4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:47.892015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2463d4-5d9f-4d96-8f0a-0e54c9e84be4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:47.925924 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331699ec-66c2-4399-934e-36c441d2cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:47.927447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331699ec-66c2-4399-934e-36c441d2cf22 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:47.927947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331699ec-66c2-4399-934e-36c441d2cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:47.928320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331699ec-66c2-4399-934e-36c441d2cf22 None admin] PATH_INFO: `/v3/users/0d7afad9c0b54bbc940291b3c1465821` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:47.945281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331699ec-66c2-4399-934e-36c441d2cf22 None admin] RBAC: Authorizing `identity:get_user(user_id=0d7afad9c0b54bbc940291b3c1465821)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:47.947359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331699ec-66c2-4399-934e-36c441d2cf22 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:47.949118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 590/1182] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:47 2022] GET /identity/v3/users/0d7afad9c0b54bbc940291b3c1465821 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:47.954926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470da8-2416-4ea9-a4af-f701114c95dc None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:48.055966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470da8-2416-4ea9-a4af-f701114c95dc None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:48.089596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29045-3c2b-4eff-9086-28818e1ca096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:48.090247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29045-3c2b-4eff-9086-28818e1ca096 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:48.090532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29045-3c2b-4eff-9086-28818e1ca096 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:48.090812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29045-3c2b-4eff-9086-28818e1ca096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:48.106970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:48.173865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f29045-3c2b-4eff-9086-28818e1ca096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:48.175330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f29045-3c2b-4eff-9086-28818e1ca096 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:48.278947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 593/1183] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:15:47 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:15:48.285114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331699ec-66c2-4399-934e-36c441d2cf22 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:48.289546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:48.393977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331699ec-66c2-4399-934e-36c441d2cf22 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:48.430157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d904e9e-12bc-458f-a0fa-c5afccff3775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:48.431012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d904e9e-12bc-458f-a0fa-c5afccff3775 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:48.431291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d904e9e-12bc-458f-a0fa-c5afccff3775 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:48.431582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d904e9e-12bc-458f-a0fa-c5afccff3775 None admin] PATH_INFO: `/v3/projects/829ddca0605d41819c17437b2d96013b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:48.432810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d904e9e-12bc-458f-a0fa-c5afccff3775 None admin] RBAC: Authorizing `identity:get_project(project_id=829ddca0605d41819c17437b2d96013b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:48.434287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d904e9e-12bc-458f-a0fa-c5afccff3775 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:48.436052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 591/1184] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:48 2022] GET /identity/v3/projects/829ddca0605d41819c17437b2d96013b => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:48.442231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29045-3c2b-4eff-9086-28818e1ca096 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:48.481531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:48.548825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29045-3c2b-4eff-9086-28818e1ca096 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:48.584546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f9fa4-3aa5-48a9-8ede-6129aeb721df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:48.585761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9fa4-3aa5-48a9-8ede-6129aeb721df None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:48.589949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9fa4-3aa5-48a9-8ede-6129aeb721df None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:48.589949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9fa4-3aa5-48a9-8ede-6129aeb721df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:48.589949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f9fa4-3aa5-48a9-8ede-6129aeb721df None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=829ddca0605d41819c17437b2d96013b, user.id=0d7afad9c0b54bbc940291b3c1465821) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:48.589949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f9fa4-3aa5-48a9-8ede-6129aeb721df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:48.589949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f9fa4-3aa5-48a9-8ede-6129aeb721df None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:48.595003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 594/1185] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:15:48 2022] GET /identity/v3/role_assignments?user.id=0d7afad9c0b54bbc940291b3c1465821&scope.project.id=829ddca0605d41819c17437b2d96013b&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:50.811663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29774-9c12-4ad2-bb2b-c7aebd2f12f8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:50.812222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29774-9c12-4ad2-bb2b-c7aebd2f12f8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:50.812222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29774-9c12-4ad2-bb2b-c7aebd2f12f8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:50.813503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 592/1186] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:50.818638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c321a6-0ca5-47a2-9f5a-44ac884c9dde None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:50.819081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c321a6-0ca5-47a2-9f5a-44ac884c9dde None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:50.819178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c321a6-0ca5-47a2-9f5a-44ac884c9dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:50.836042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e4c321a6-0ca5-47a2-9f5a-44ac884c9dde None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:50.837206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e4c321a6-0ca5-47a2-9f5a-44ac884c9dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:50.901373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 595/1187] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:50 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:50.924503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29774-9c12-4ad2-bb2b-c7aebd2f12f8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:50.993914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:51.023563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29774-9c12-4ad2-bb2b-c7aebd2f12f8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:51.056689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c3e87-7e5b-47ea-96bb-52a8858baa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:51.057467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c3e87-7e5b-47ea-96bb-52a8858baa7b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:51.057751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c3e87-7e5b-47ea-96bb-52a8858baa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:51.058029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c3e87-7e5b-47ea-96bb-52a8858baa7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:51.067995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c3e87-7e5b-47ea-96bb-52a8858baa7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a07c3e87-7e5b-47ea-96bb-52a8858baa7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:15:51.076061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:51.077184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:15:51.078242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 593/1188] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:15:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:51.083306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c321a6-0ca5-47a2-9f5a-44ac884c9dde None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:51.112998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:51.181768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c321a6-0ca5-47a2-9f5a-44ac884c9dde None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:51.216480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78bac-deb8-443d-8202-823bdbc95919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:51.217150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78bac-deb8-443d-8202-823bdbc95919 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:51.217433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78bac-deb8-443d-8202-823bdbc95919 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:51.217710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78bac-deb8-443d-8202-823bdbc95919 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:51.218466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78bac-deb8-443d-8202-823bdbc95919 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:51.218774 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78bac-deb8-443d-8202-823bdbc95919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:51.220198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78bac-deb8-443d-8202-823bdbc95919 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:51.230324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 596/1189] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:15:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:51.236434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c3e87-7e5b-47ea-96bb-52a8858baa7b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:51.333350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c3e87-7e5b-47ea-96bb-52a8858baa7b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:51.361963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:51.367211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def67abd-ed28-448b-a85d-650d0bbd9f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:51.368094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def67abd-ed28-448b-a85d-650d0bbd9f94 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:51.368375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def67abd-ed28-448b-a85d-650d0bbd9f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:51.368647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def67abd-ed28-448b-a85d-650d0bbd9f94 None admin] PATH_INFO: `/v3/users/0d7afad9c0b54bbc940291b3c1465821` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:51.369823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def67abd-ed28-448b-a85d-650d0bbd9f94 None admin] RBAC: Authorizing `identity:get_user(user_id=0d7afad9c0b54bbc940291b3c1465821)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:51.371446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def67abd-ed28-448b-a85d-650d0bbd9f94 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:51.373389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 594/1190] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:51 2022] GET /identity/v3/users/0d7afad9c0b54bbc940291b3c1465821 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:51.379184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78bac-deb8-443d-8202-823bdbc95919 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:51.468141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:51.477043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78bac-deb8-443d-8202-823bdbc95919 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:51.511592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7127725-359c-4f25-8eab-525acb8487d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:51.512501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7127725-359c-4f25-8eab-525acb8487d1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:51.512791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7127725-359c-4f25-8eab-525acb8487d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:51.513061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7127725-359c-4f25-8eab-525acb8487d1 None admin] PATH_INFO: `/v3/projects/829ddca0605d41819c17437b2d96013b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:51.514329 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7127725-359c-4f25-8eab-525acb8487d1 None admin] RBAC: Authorizing `identity:get_project(project_id=829ddca0605d41819c17437b2d96013b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:51.515815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7127725-359c-4f25-8eab-525acb8487d1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:51.517535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 597/1191] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:51 2022] GET /identity/v3/projects/829ddca0605d41819c17437b2d96013b => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:51.523478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def67abd-ed28-448b-a85d-650d0bbd9f94 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:51.620622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def67abd-ed28-448b-a85d-650d0bbd9f94 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:51.653846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893bdfe-b08e-4e14-97c4-4650f724f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:51.654724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893bdfe-b08e-4e14-97c4-4650f724f4d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:51.655005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893bdfe-b08e-4e14-97c4-4650f724f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:51.655283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893bdfe-b08e-4e14-97c4-4650f724f4d0 None admin] PATH_INFO: `/v3/projects/829ddca0605d41819c17437b2d96013b/users/0d7afad9c0b54bbc940291b3c1465821/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:51.657293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893bdfe-b08e-4e14-97c4-4650f724f4d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=829ddca0605d41819c17437b2d96013b, user_id=0d7afad9c0b54bbc940291b3c1465821, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:51.658724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893bdfe-b08e-4e14-97c4-4650f724f4d0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:51.671406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 595/1192] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:15:51 2022] PUT /identity/v3/projects/829ddca0605d41819c17437b2d96013b/users/0d7afad9c0b54bbc940291b3c1465821/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:15:53.868911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524232-1fd2-443e-9a31-51bd445e401c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:53.869445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524232-1fd2-443e-9a31-51bd445e401c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:53.869445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524232-1fd2-443e-9a31-51bd445e401c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:53.870809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 598/1193] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:15:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:15:53.875976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221930b-b9ce-4c01-9c2b-6f8e921aceec None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:53.876407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221930b-b9ce-4c01-9c2b-6f8e921aceec None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:53.876537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221930b-b9ce-4c01-9c2b-6f8e921aceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:53.893568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8221930b-b9ce-4c01-9c2b-6f8e921aceec None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:15:53.894752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8221930b-b9ce-4c01-9c2b-6f8e921aceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:15:53.950111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:53.962004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 596/1194] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:15:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:53.985359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524232-1fd2-443e-9a31-51bd445e401c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:54.084435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524232-1fd2-443e-9a31-51bd445e401c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:54.118888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080d0c2-659a-4308-8fcb-048be59aba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:54.119765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080d0c2-659a-4308-8fcb-048be59aba20 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:54.119987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080d0c2-659a-4308-8fcb-048be59aba20 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:54.120259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080d0c2-659a-4308-8fcb-048be59aba20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:54.130674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080d0c2-659a-4308-8fcb-048be59aba20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-b080d0c2-659a-4308-8fcb-048be59aba20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:15:54.138275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:15:54.139424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:15:54.140502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 599/1195] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:15:54.145540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221930b-b9ce-4c01-9c2b-6f8e921aceec None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:54.255131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221930b-b9ce-4c01-9c2b-6f8e921aceec None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:54.287618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13d2a4-f012-4c04-be0b-2b4eb8e02af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:54.288814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d2a4-f012-4c04-be0b-2b4eb8e02af3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:54.289097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d2a4-f012-4c04-be0b-2b4eb8e02af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:54.289373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d2a4-f012-4c04-be0b-2b4eb8e02af3 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:54.290129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13d2a4-f012-4c04-be0b-2b4eb8e02af3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:54.290435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13d2a4-f012-4c04-be0b-2b4eb8e02af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:54.291835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13d2a4-f012-4c04-be0b-2b4eb8e02af3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:54.299727 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 597/1196] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:15:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:54.306220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080d0c2-659a-4308-8fcb-048be59aba20 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:54.327296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:54.404762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080d0c2-659a-4308-8fcb-048be59aba20 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:54.437234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe4195-55bb-4a06-b758-9158a8639c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:54.438080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe4195-55bb-4a06-b758-9158a8639c47 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:54.438361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe4195-55bb-4a06-b758-9158a8639c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:54.438634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe4195-55bb-4a06-b758-9158a8639c47 None admin] PATH_INFO: `/v3/users/0d7afad9c0b54bbc940291b3c1465821` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:54.439827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe4195-55bb-4a06-b758-9158a8639c47 None admin] RBAC: Authorizing `identity:get_user(user_id=0d7afad9c0b54bbc940291b3c1465821)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:54.441260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe4195-55bb-4a06-b758-9158a8639c47 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:54.442861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 600/1197] 10.222.0.112 () {56 vars in 1182 bytes} [Fri Jun 3 16:15:54 2022] GET /identity/v3/users/0d7afad9c0b54bbc940291b3c1465821 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:54.448646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13d2a4-f012-4c04-be0b-2b4eb8e02af3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:54.500665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:54.547262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13d2a4-f012-4c04-be0b-2b4eb8e02af3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:54.578841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2e32e-e675-4b20-b325-85af06aa75e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:54.579475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2e32e-e675-4b20-b325-85af06aa75e2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:54.579788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2e32e-e675-4b20-b325-85af06aa75e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:54.580065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2e32e-e675-4b20-b325-85af06aa75e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:54.645941 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2e32e-e675-4b20-b325-85af06aa75e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:54.647423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2e32e-e675-4b20-b325-85af06aa75e2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:54.696890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:54.743381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 598/1198] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:15:54 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:15:54.749255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe4195-55bb-4a06-b758-9158a8639c47 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:54.833795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:54.845807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe4195-55bb-4a06-b758-9158a8639c47 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:54.879842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef8731-5898-4913-ac56-7704d300762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:54.880701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef8731-5898-4913-ac56-7704d300762b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:54.880982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef8731-5898-4913-ac56-7704d300762b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:54.881257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef8731-5898-4913-ac56-7704d300762b None admin] PATH_INFO: `/v3/projects/829ddca0605d41819c17437b2d96013b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:54.882441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef8731-5898-4913-ac56-7704d300762b None admin] RBAC: Authorizing `identity:get_project(project_id=829ddca0605d41819c17437b2d96013b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:54.883900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef8731-5898-4913-ac56-7704d300762b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:54.885574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 601/1199] 10.222.0.112 () {56 vars in 1191 bytes} [Fri Jun 3 16:15:54 2022] GET /identity/v3/projects/829ddca0605d41819c17437b2d96013b => generated 362 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:15:54.891826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2e32e-e675-4b20-b325-85af06aa75e2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:15:54.985923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2e32e-e675-4b20-b325-85af06aa75e2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:15:55.017938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc22a7-092a-4186-8a25-24515b92322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:15:55.018570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc22a7-092a-4186-8a25-24515b92322d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:15:55.018849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc22a7-092a-4186-8a25-24515b92322d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:15:55.019119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc22a7-092a-4186-8a25-24515b92322d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:15:55.019964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc22a7-092a-4186-8a25-24515b92322d None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=829ddca0605d41819c17437b2d96013b, user.id=0d7afad9c0b54bbc940291b3c1465821) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:15:55.020270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc22a7-092a-4186-8a25-24515b92322d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:15:55.021684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc22a7-092a-4186-8a25-24515b92322d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:15:55.027294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 599/1200] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:15:54 2022] GET /identity/v3/role_assignments?user.id=0d7afad9c0b54bbc940291b3c1465821&scope.project.id=829ddca0605d41819c17437b2d96013b&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 610 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:16:04.875922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=22 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:05.025306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:56.594333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f756e4-d6c9-4cbb-8ed3-3637f13882de None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:16:56.594906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f756e4-d6c9-4cbb-8ed3-3637f13882de None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:16:56.595021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f756e4-d6c9-4cbb-8ed3-3637f13882de None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:16:56.596558 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 602/1201] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:16:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:16:56.605260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d4fd-a5a0-466e-b117-3e674c6cd047 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:16:56.605836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d4fd-a5a0-466e-b117-3e674c6cd047 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:16:56.605836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d4fd-a5a0-466e-b117-3e674c6cd047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:16:56.627305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2692d4fd-a5a0-466e-b117-3e674c6cd047 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:16:56.629190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2692d4fd-a5a0-466e-b117-3e674c6cd047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:16:56.744081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 600/1202] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:16:56 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:16:56.770694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f756e4-d6c9-4cbb-8ed3-3637f13882de None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:16:56.961909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f756e4-d6c9-4cbb-8ed3-3637f13882de None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:16:57.022204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407604d4-1012-4d11-89eb-02e9d69a57bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:16:57.023131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407604d4-1012-4d11-89eb-02e9d69a57bf None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:16:57.023443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407604d4-1012-4d11-89eb-02e9d69a57bf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:16:57.023796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407604d4-1012-4d11-89eb-02e9d69a57bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:16:57.042433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407604d4-1012-4d11-89eb-02e9d69a57bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:16:57.044716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407604d4-1012-4d11-89eb-02e9d69a57bf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-407604d4-1012-4d11-89eb-02e9d69a57bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:16:57.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:16:57.082729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:16:57.083770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:16:57.083770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:16:57.083770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:16:57.083770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:16:57.089642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 603/1203] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:16:57.093987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d4fd-a5a0-466e-b117-3e674c6cd047 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:16:57.278833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d4fd-a5a0-466e-b117-3e674c6cd047 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:16:57.329228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:57.344893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69a40e-a735-4239-bfd5-bb44214c8492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:16:57.346002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a40e-a735-4239-bfd5-bb44214c8492 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:16:57.346518 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a40e-a735-4239-bfd5-bb44214c8492 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:16:57.347474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a40e-a735-4239-bfd5-bb44214c8492 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:16:57.353812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69a40e-a735-4239-bfd5-bb44214c8492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:16:57.353812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69a40e-a735-4239-bfd5-bb44214c8492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:16:57.353812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69a40e-a735-4239-bfd5-bb44214c8492 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:16:57.371693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 601/1204] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:16:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:16:57.377590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407604d4-1012-4d11-89eb-02e9d69a57bf None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:16:57.475768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:57.564085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407604d4-1012-4d11-89eb-02e9d69a57bf None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:16:57.625268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8d6b4-5dd8-4b33-a13f-9032a85a43db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:16:57.626305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8d6b4-5dd8-4b33-a13f-9032a85a43db None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:16:57.626305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8d6b4-5dd8-4b33-a13f-9032a85a43db None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:16:57.626621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8d6b4-5dd8-4b33-a13f-9032a85a43db None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:16:57.627401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8d6b4-5dd8-4b33-a13f-9032a85a43db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:16:57.629608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8d6b4-5dd8-4b33-a13f-9032a85a43db None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:16:57.661143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 604/1205] 10.222.0.112 () {60 vars in 1137 bytes} [Fri Jun 3 16:16:57 2022] POST /identity/v3/users => generated 252 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:17:00.385108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fbadb-e048-4739-bd7a-cc682ea909aa None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:00.385741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fbadb-e048-4739-bd7a-cc682ea909aa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:00.385741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fbadb-e048-4739-bd7a-cc682ea909aa None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:00.387016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 602/1206] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:17:00.394063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6678509-cc13-45b7-ad5b-0aa0e4d4d95c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:00.394632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6678509-cc13-45b7-ad5b-0aa0e4d4d95c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:00.394632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6678509-cc13-45b7-ad5b-0aa0e4d4d95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:00.413078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c6678509-cc13-45b7-ad5b-0aa0e4d4d95c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:00.414723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c6678509-cc13-45b7-ad5b-0aa0e4d4d95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:00.498053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 605/1207] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:00 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:17:00.527141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fbadb-e048-4739-bd7a-cc682ea909aa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:00.661794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fbadb-e048-4739-bd7a-cc682ea909aa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:00.710702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592933ee-fa2e-4c2b-babc-029110dac35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:00.711965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592933ee-fa2e-4c2b-babc-029110dac35f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:00.711965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592933ee-fa2e-4c2b-babc-029110dac35f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:00.712254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592933ee-fa2e-4c2b-babc-029110dac35f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:00.727216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592933ee-fa2e-4c2b-babc-029110dac35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-592933ee-fa2e-4c2b-babc-029110dac35f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:17:00.737141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:00.739229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:00.740571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 603/1208] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:17:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:00.745500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6678509-cc13-45b7-ad5b-0aa0e4d4d95c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:00.795401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:00.868681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6678509-cc13-45b7-ad5b-0aa0e4d4d95c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:00.909028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5881f2b-79b5-41a8-a5d5-7950160f07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:00.909722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5881f2b-79b5-41a8-a5d5-7950160f07cb None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:00.910018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5881f2b-79b5-41a8-a5d5-7950160f07cb None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:00.910293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5881f2b-79b5-41a8-a5d5-7950160f07cb None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:00.911112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5881f2b-79b5-41a8-a5d5-7950160f07cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:00.911419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5881f2b-79b5-41a8-a5d5-7950160f07cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:00.913043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5881f2b-79b5-41a8-a5d5-7950160f07cb None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:00.922625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 606/1209] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:17:00 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:00.929422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592933ee-fa2e-4c2b-babc-029110dac35f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:01.006736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:01.071942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592933ee-fa2e-4c2b-babc-029110dac35f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:01.120620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203ef49-78ca-4e84-a19f-00c6bad53faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:01.122338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203ef49-78ca-4e84-a19f-00c6bad53faa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:01.122338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203ef49-78ca-4e84-a19f-00c6bad53faa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:01.122700 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203ef49-78ca-4e84-a19f-00c6bad53faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:01.140543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203ef49-78ca-4e84-a19f-00c6bad53faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:01.142912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203ef49-78ca-4e84-a19f-00c6bad53faa None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f203ef49-78ca-4e84-a19f-00c6bad53faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:01.162143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:01.163391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:01.164664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:01.164664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:01.164664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:01.164664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:01.164664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 604/1210] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:01.170103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5881f2b-79b5-41a8-a5d5-7950160f07cb None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:01.299426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:01.304858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5881f2b-79b5-41a8-a5d5-7950160f07cb None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:01.364239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe434-f7b8-4190-8ea0-a5df28f57bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:01.364956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe434-f7b8-4190-8ea0-a5df28f57bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:01.365263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe434-f7b8-4190-8ea0-a5df28f57bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:01.365650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe434-f7b8-4190-8ea0-a5df28f57bd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:01.366592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fe434-f7b8-4190-8ea0-a5df28f57bd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:01.367027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fe434-f7b8-4190-8ea0-a5df28f57bd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:01.368824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fe434-f7b8-4190-8ea0-a5df28f57bd3 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:01.388081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 607/1211] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:17:01.394059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203ef49-78ca-4e84-a19f-00c6bad53faa None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:01.523116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203ef49-78ca-4e84-a19f-00c6bad53faa None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:01.525943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:01.593791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffe220-a52a-451d-8d6d-f08259272c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:01.595680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffe220-a52a-451d-8d6d-f08259272c65 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:01.596158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffe220-a52a-451d-8d6d-f08259272c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:01.597509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffe220-a52a-451d-8d6d-f08259272c65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:01.613705 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffe220-a52a-451d-8d6d-f08259272c65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:01.616371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffe220-a52a-451d-8d6d-f08259272c65 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ddffe220-a52a-451d-8d6d-f08259272c65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:17:01.635423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:01.636730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:01.642496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 605/1212] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:17:01.644227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe434-f7b8-4190-8ea0-a5df28f57bd3 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:01.809111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe434-f7b8-4190-8ea0-a5df28f57bd3 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:01.858379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016db96-9033-467f-a5f7-3de161679f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:01.859095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016db96-9033-467f-a5f7-3de161679f4e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:01.859378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016db96-9033-467f-a5f7-3de161679f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:01.859700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016db96-9033-467f-a5f7-3de161679f4e None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:01.860612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016db96-9033-467f-a5f7-3de161679f4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:01.860923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016db96-9033-467f-a5f7-3de161679f4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:01.862569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016db96-9033-467f-a5f7-3de161679f4e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:01.883119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 608/1213] 10.222.0.112 () {56 vars in 1148 bytes} [Fri Jun 3 16:17:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:17:01.892261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffe220-a52a-451d-8d6d-f08259272c65 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:02.088573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffe220-a52a-451d-8d6d-f08259272c65 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:02.142653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363910c-a1f2-4dba-bd79-2d43962a3d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:02.143218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363910c-a1f2-4dba-bd79-2d43962a3d06 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:02.143620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363910c-a1f2-4dba-bd79-2d43962a3d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:02.144414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363910c-a1f2-4dba-bd79-2d43962a3d06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:02.192201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:02.251950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363910c-a1f2-4dba-bd79-2d43962a3d06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:02.253989 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363910c-a1f2-4dba-bd79-2d43962a3d06 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:02.421164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 606/1214] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:17:01 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:17:02.423223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016db96-9033-467f-a5f7-3de161679f4e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:02.449788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:02.563134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016db96-9033-467f-a5f7-3de161679f4e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:02.604012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2da3-e28b-48f7-89b4-662102548abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:02.604826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2da3-e28b-48f7-89b4-662102548abd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:02.605137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2da3-e28b-48f7-89b4-662102548abd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:02.605398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2da3-e28b-48f7-89b4-662102548abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:02.617895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d2da3-e28b-48f7-89b4-662102548abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:02.619409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d2da3-e28b-48f7-89b4-662102548abd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-bb1d2da3-e28b-48f7-89b4-662102548abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:02.639495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:02.649666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:02.650918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:02.650918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:02.650918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:02.650918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:02.650918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 609/1215] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:02.651357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363910c-a1f2-4dba-bd79-2d43962a3d06 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:02.755019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:02.811865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363910c-a1f2-4dba-bd79-2d43962a3d06 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:02.863682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5510261-23ec-4761-89fb-bca6e6561f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:02.864511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510261-23ec-4761-89fb-bca6e6561f48 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:02.864898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510261-23ec-4761-89fb-bca6e6561f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:02.865279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510261-23ec-4761-89fb-bca6e6561f48 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:02.866197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510261-23ec-4761-89fb-bca6e6561f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:02.866631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510261-23ec-4761-89fb-bca6e6561f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:02.868165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510261-23ec-4761-89fb-bca6e6561f48 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:02.883348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 607/1216] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:02.891200 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2da3-e28b-48f7-89b4-662102548abd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:02.983176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:03.036953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2da3-e28b-48f7-89b4-662102548abd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:03.080123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0f9fd-653b-4db6-be16-2807a1aa20f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:03.081584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0f9fd-653b-4db6-be16-2807a1aa20f8 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:03.081922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0f9fd-653b-4db6-be16-2807a1aa20f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:03.082324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0f9fd-653b-4db6-be16-2807a1aa20f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:03.091683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0f9fd-653b-4db6-be16-2807a1aa20f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:03.093363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0f9fd-653b-4db6-be16-2807a1aa20f8 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-53d0f9fd-653b-4db6-be16-2807a1aa20f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:17:03.111385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:03.112698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:03.113623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:17:03.113623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:17:03.113623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:17:03.113623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:17:03.113623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:17:03.113623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:17:03.113623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:03.113623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:03.118531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 610/1217] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:17:03.120581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5510261-23ec-4761-89fb-bca6e6561f48 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:03.289619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5510261-23ec-4761-89fb-bca6e6561f48 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:03.325286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:03.348358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0b6a-8159-463b-97b3-d47defcd2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:03.349498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0b6a-8159-463b-97b3-d47defcd2c9a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:03.349924 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0b6a-8159-463b-97b3-d47defcd2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:03.350356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0b6a-8159-463b-97b3-d47defcd2c9a None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:03.351598 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0b6a-8159-463b-97b3-d47defcd2c9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:03.352105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0b6a-8159-463b-97b3-d47defcd2c9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:03.355123 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0b6a-8159-463b-97b3-d47defcd2c9a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:03.379545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 608/1218] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:03.389035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0f9fd-653b-4db6-be16-2807a1aa20f8 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:03.527344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0f9fd-653b-4db6-be16-2807a1aa20f8 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:03.578421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:03.587626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3113aab-1103-4269-80df-fd35ad9cf25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:03.588604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3113aab-1103-4269-80df-fd35ad9cf25e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:03.588892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3113aab-1103-4269-80df-fd35ad9cf25e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:03.589174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3113aab-1103-4269-80df-fd35ad9cf25e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:03.590165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3113aab-1103-4269-80df-fd35ad9cf25e None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=88e5d3ba49164f55a063aa60643bd421) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:03.590523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3113aab-1103-4269-80df-fd35ad9cf25e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:03.592100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3113aab-1103-4269-80df-fd35ad9cf25e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:03.599249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 611/1219] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:17:03 2022] GET /identity/v3/role_assignments?user.id=88e5d3ba49164f55a063aa60643bd421&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:06.117446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d39c1d-e119-479c-9040-d7ad1e084d92 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:06.118344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d39c1d-e119-479c-9040-d7ad1e084d92 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:06.118344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d39c1d-e119-479c-9040-d7ad1e084d92 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:06.120478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 609/1220] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:06 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:17:06.130204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162eba-3022-4bc1-9df7-afa5a33264ba None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:06.130741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162eba-3022-4bc1-9df7-afa5a33264ba None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:06.131234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162eba-3022-4bc1-9df7-afa5a33264ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:06.164616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b0162eba-3022-4bc1-9df7-afa5a33264ba None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:06.165911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b0162eba-3022-4bc1-9df7-afa5a33264ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:06.280155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 612/1221] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:06 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:17:06.306001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d39c1d-e119-479c-9040-d7ad1e084d92 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:06.464957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d39c1d-e119-479c-9040-d7ad1e084d92 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:06.507609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fbd21-f750-42c5-9ae5-dbfec4382ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:06.508507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fbd21-f750-42c5-9ae5-dbfec4382ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:06.508875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fbd21-f750-42c5-9ae5-dbfec4382ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:06.509340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fbd21-f750-42c5-9ae5-dbfec4382ea5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:06.524631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fbd21-f750-42c5-9ae5-dbfec4382ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-863fbd21-f750-42c5-9ae5-dbfec4382ea5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:17:06.534277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:06.536154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:06.537853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 610/1222] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:17:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:06.543401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162eba-3022-4bc1-9df7-afa5a33264ba None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:06.709046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162eba-3022-4bc1-9df7-afa5a33264ba None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:06.741703 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:06.760687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303815d-ce99-4169-aa9d-241df6820d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:06.761588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303815d-ce99-4169-aa9d-241df6820d5a None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:06.761875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303815d-ce99-4169-aa9d-241df6820d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:06.762161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303815d-ce99-4169-aa9d-241df6820d5a None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:06.763393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303815d-ce99-4169-aa9d-241df6820d5a None admin] RBAC: Adding query filter params (name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:06.763953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303815d-ce99-4169-aa9d-241df6820d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:06.766335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303815d-ce99-4169-aa9d-241df6820d5a None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:06.782147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 613/1223] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:17:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:17:06.789390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fbd21-f750-42c5-9ae5-dbfec4382ea5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:06.839255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:06.918602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fbd21-f750-42c5-9ae5-dbfec4382ea5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:06.964106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fd76a-61e2-4416-9fef-4bdc9067164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:06.965013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fd76a-61e2-4416-9fef-4bdc9067164b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:06.965400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fd76a-61e2-4416-9fef-4bdc9067164b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:06.965679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fd76a-61e2-4416-9fef-4bdc9067164b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:06.981066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fd76a-61e2-4416-9fef-4bdc9067164b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:06.982661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fd76a-61e2-4416-9fef-4bdc9067164b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ff6fd76a-61e2-4416-9fef-4bdc9067164b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:07.002667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:07.003898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:07.004994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:07.004994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:07.004994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:07.004994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:07.004994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 611/1224] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:17:07.009875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303815d-ce99-4169-aa9d-241df6820d5a None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:07.164887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303815d-ce99-4169-aa9d-241df6820d5a None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:07.204952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc58e-36fe-4a6d-919d-944ad6d69a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:07.205841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc58e-36fe-4a6d-919d-944ad6d69a14 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:07.206309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc58e-36fe-4a6d-919d-944ad6d69a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:07.207476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc58e-36fe-4a6d-919d-944ad6d69a14 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:07.208370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cc58e-36fe-4a6d-919d-944ad6d69a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:07.208696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cc58e-36fe-4a6d-919d-944ad6d69a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:07.210286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cc58e-36fe-4a6d-919d-944ad6d69a14 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:07.223913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 614/1225] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:07.229909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fd76a-61e2-4416-9fef-4bdc9067164b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:07.342275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:07.350285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fd76a-61e2-4416-9fef-4bdc9067164b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:07.394255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf046-c4d9-435a-ac7b-e5272ab8cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:07.395096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf046-c4d9-435a-ac7b-e5272ab8cd2f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:07.395376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf046-c4d9-435a-ac7b-e5272ab8cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:07.395680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf046-c4d9-435a-ac7b-e5272ab8cd2f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:07.404386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cf046-c4d9-435a-ac7b-e5272ab8cd2f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:07.405889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cf046-c4d9-435a-ac7b-e5272ab8cd2f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f36cf046-c4d9-435a-ac7b-e5272ab8cd2f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:17:07.422630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:07.424530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:07.426599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 612/1226] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:07.431514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc58e-36fe-4a6d-919d-944ad6d69a14 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:07.517862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:07.615137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc58e-36fe-4a6d-919d-944ad6d69a14 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:07.670125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3803e44-7aeb-4424-8a65-cd87c4cd5d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:07.670719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3803e44-7aeb-4424-8a65-cd87c4cd5d6b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:07.670979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3803e44-7aeb-4424-8a65-cd87c4cd5d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:07.671288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3803e44-7aeb-4424-8a65-cd87c4cd5d6b None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:07.673070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3803e44-7aeb-4424-8a65-cd87c4cd5d6b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:07.673400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3803e44-7aeb-4424-8a65-cd87c4cd5d6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:07.675030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3803e44-7aeb-4424-8a65-cd87c4cd5d6b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:07.697336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 615/1227] 10.222.0.112 () {56 vars in 1148 bytes} [Fri Jun 3 16:17:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:07.703964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf046-c4d9-435a-ac7b-e5272ab8cd2f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:07.848926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf046-c4d9-435a-ac7b-e5272ab8cd2f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:07.905596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fdd54-39db-4d77-8acc-4737a6612e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:07.906445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fdd54-39db-4d77-8acc-4737a6612e46 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:07.906731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fdd54-39db-4d77-8acc-4737a6612e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:07.907053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fdd54-39db-4d77-8acc-4737a6612e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:07.921468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fdd54-39db-4d77-8acc-4737a6612e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:07.922999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fdd54-39db-4d77-8acc-4737a6612e46 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-375fdd54-39db-4d77-8acc-4737a6612e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:07.949821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:07.951686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:07.953581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:07.953581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:07.953581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:07.953581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:07.953581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 613/1228] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:07.961358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3803e44-7aeb-4424-8a65-cd87c4cd5d6b None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:08.108307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3803e44-7aeb-4424-8a65-cd87c4cd5d6b None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:08.112545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:08.152015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00140f-31f5-481c-b8c8-9bd145abb3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:08.152698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00140f-31f5-481c-b8c8-9bd145abb3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:08.152981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00140f-31f5-481c-b8c8-9bd145abb3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:08.153261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00140f-31f5-481c-b8c8-9bd145abb3f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:08.154075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00140f-31f5-481c-b8c8-9bd145abb3f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:08.154497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00140f-31f5-481c-b8c8-9bd145abb3f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:08.156218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00140f-31f5-481c-b8c8-9bd145abb3f2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:08.173715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 616/1229] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:08.178416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fdd54-39db-4d77-8acc-4737a6612e46 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:08.188994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:08.305929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fdd54-39db-4d77-8acc-4737a6612e46 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:08.353505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788066b3-1726-4a4e-bc65-a533df1f4e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:08.354351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788066b3-1726-4a4e-bc65-a533df1f4e5b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:08.354753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788066b3-1726-4a4e-bc65-a533df1f4e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:08.355033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788066b3-1726-4a4e-bc65-a533df1f4e5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:08.365207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788066b3-1726-4a4e-bc65-a533df1f4e5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:08.366979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788066b3-1726-4a4e-bc65-a533df1f4e5b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-788066b3-1726-4a4e-bc65-a533df1f4e5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:17:08.394748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:08.396023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:08.400526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:17:08.400526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:17:08.400526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:17:08.400526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:17:08.400526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:17:08.400526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:17:08.400526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:08.400526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:08.400526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 614/1230] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:08.403389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00140f-31f5-481c-b8c8-9bd145abb3f2 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:08.557197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00140f-31f5-481c-b8c8-9bd145abb3f2 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:08.597500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95826a4-b663-4b52-82ed-df1d02d238dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:08.598411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95826a4-b663-4b52-82ed-df1d02d238dd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:08.598596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95826a4-b663-4b52-82ed-df1d02d238dd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:08.598803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95826a4-b663-4b52-82ed-df1d02d238dd None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:08.599648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95826a4-b663-4b52-82ed-df1d02d238dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:08.599958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95826a4-b663-4b52-82ed-df1d02d238dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:08.601492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95826a4-b663-4b52-82ed-df1d02d238dd None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:08.620741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 617/1231] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:08.634356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788066b3-1726-4a4e-bc65-a533df1f4e5b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:08.747448 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:08.808823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788066b3-1726-4a4e-bc65-a533df1f4e5b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:08.850120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed69977-bd7a-405c-80e6-fa7e91fb8250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:08.851630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69977-bd7a-405c-80e6-fa7e91fb8250 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:08.852055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69977-bd7a-405c-80e6-fa7e91fb8250 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:08.852460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69977-bd7a-405c-80e6-fa7e91fb8250 None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/88e5d3ba49164f55a063aa60643bd421/roles/32d5f0d8a0564b0286e98637266edf11` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:08.877805 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed69977-bd7a-405c-80e6-fa7e91fb8250 None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=88e5d3ba49164f55a063aa60643bd421, role_id=32d5f0d8a0564b0286e98637266edf11)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:08.879438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed69977-bd7a-405c-80e6-fa7e91fb8250 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:08.895284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 615/1232] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:17:08 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/88e5d3ba49164f55a063aa60643bd421/roles/32d5f0d8a0564b0286e98637266edf11 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:17:11.218350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f000d5-8d0f-46bb-b1ca-60434601c460 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:11.219114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f000d5-8d0f-46bb-b1ca-60434601c460 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:11.219114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f000d5-8d0f-46bb-b1ca-60434601c460 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:11.220343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 618/1233] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:17:11.226939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba06e09-5cf1-4b2f-9d46-aed004941a0b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:11.227599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba06e09-5cf1-4b2f-9d46-aed004941a0b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:11.227599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba06e09-5cf1-4b2f-9d46-aed004941a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:11.246326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1ba06e09-5cf1-4b2f-9d46-aed004941a0b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:11.247638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1ba06e09-5cf1-4b2f-9d46-aed004941a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:11.323877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 616/1234] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:11 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:17:11.349366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f000d5-8d0f-46bb-b1ca-60434601c460 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:11.378198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:11.463863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f000d5-8d0f-46bb-b1ca-60434601c460 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:11.502082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9611ca-e014-4b4b-a4d7-ce36b1c8bebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:11.502926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9611ca-e014-4b4b-a4d7-ce36b1c8bebd None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:11.503224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9611ca-e014-4b4b-a4d7-ce36b1c8bebd None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:11.503493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9611ca-e014-4b4b-a4d7-ce36b1c8bebd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:11.516367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9611ca-e014-4b4b-a4d7-ce36b1c8bebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-4e9611ca-e014-4b4b-a4d7-ce36b1c8bebd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:17:11.526219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:11.528316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 16:17:11.530163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:11.534151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 619/1235] 10.222.0.112 () {56 vars in 1107 bytes} [Fri Jun 3 16:17:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:11.535329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba06e09-5cf1-4b2f-9d46-aed004941a0b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:11.591515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:11.654486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba06e09-5cf1-4b2f-9d46-aed004941a0b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:11.691894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c9e5-8c32-4a2a-9c4b-e9cd29ff9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:11.692763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c9e5-8c32-4a2a-9c4b-e9cd29ff9b70 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:11.693198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c9e5-8c32-4a2a-9c4b-e9cd29ff9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:11.693486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c9e5-8c32-4a2a-9c4b-e9cd29ff9b70 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:11.694236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c9e5-8c32-4a2a-9c4b-e9cd29ff9b70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:11.694550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c9e5-8c32-4a2a-9c4b-e9cd29ff9b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:11.696006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c9e5-8c32-4a2a-9c4b-e9cd29ff9b70 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:11.704931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 617/1236] 10.222.0.112 () {56 vars in 1108 bytes} [Fri Jun 3 16:17:11 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:11.711380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9611ca-e014-4b4b-a4d7-ce36b1c8bebd None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:11.804475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:11.821571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9611ca-e014-4b4b-a4d7-ce36b1c8bebd None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:11.856587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafb2ec-610a-449e-9140-766d6643b889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:11.857380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafb2ec-610a-449e-9140-766d6643b889 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:11.857659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafb2ec-610a-449e-9140-766d6643b889 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:11.857940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafb2ec-610a-449e-9140-766d6643b889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:11.869010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafb2ec-610a-449e-9140-766d6643b889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:11.870478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafb2ec-610a-449e-9140-766d6643b889 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-0aafb2ec-610a-449e-9140-766d6643b889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:11.890686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:11.894325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:11.895657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:11.895657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:11.895657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:11.895657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:11.895657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 620/1237] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:11.898801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c9e5-8c32-4a2a-9c4b-e9cd29ff9b70 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:12.012685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c9e5-8c32-4a2a-9c4b-e9cd29ff9b70 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:12.024172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:12.051951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad963eee-9ebc-4ce6-afb1-53d3b9998581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:12.052612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad963eee-9ebc-4ce6-afb1-53d3b9998581 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:12.052893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad963eee-9ebc-4ce6-afb1-53d3b9998581 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:12.053160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad963eee-9ebc-4ce6-afb1-53d3b9998581 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:12.053899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad963eee-9ebc-4ce6-afb1-53d3b9998581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:12.054186 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad963eee-9ebc-4ce6-afb1-53d3b9998581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:12.055697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad963eee-9ebc-4ce6-afb1-53d3b9998581 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:12.069139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 618/1238] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:12.075438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafb2ec-610a-449e-9140-766d6643b889 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:12.201390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafb2ec-610a-449e-9140-766d6643b889 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:12.243078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935b855-8278-459a-b3dd-f599f9389fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:12.243938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935b855-8278-459a-b3dd-f599f9389fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:12.244217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935b855-8278-459a-b3dd-f599f9389fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:12.244489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935b855-8278-459a-b3dd-f599f9389fa9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:12.247533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:12.254857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935b855-8278-459a-b3dd-f599f9389fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:12.256622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935b855-8278-459a-b3dd-f599f9389fa9 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-c935b855-8278-459a-b3dd-f599f9389fa9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:17:12.272556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:12.273602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:12.274672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:12.278692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 621/1239] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:12.279948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad963eee-9ebc-4ce6-afb1-53d3b9998581 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:12.414461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad963eee-9ebc-4ce6-afb1-53d3b9998581 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:12.452928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76261c-e4bc-479c-b3b9-77bcb0d1b4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:12.453714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76261c-e4bc-479c-b3b9-77bcb0d1b4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:12.453999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76261c-e4bc-479c-b3b9-77bcb0d1b4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:12.454336 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76261c-e4bc-479c-b3b9-77bcb0d1b4e8 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:12.455369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76261c-e4bc-479c-b3b9-77bcb0d1b4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:12.456279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76261c-e4bc-479c-b3b9-77bcb0d1b4e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:12.457890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76261c-e4bc-479c-b3b9-77bcb0d1b4e8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:12.477886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 619/1240] 10.222.0.112 () {56 vars in 1148 bytes} [Fri Jun 3 16:17:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:17:12.484344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935b855-8278-459a-b3dd-f599f9389fa9 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:12.607865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935b855-8278-459a-b3dd-f599f9389fa9 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:12.652015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e77c6-b4c1-40ca-beca-41429a1d7447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:12.652839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e77c6-b4c1-40ca-beca-41429a1d7447 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:12.653231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e77c6-b4c1-40ca-beca-41429a1d7447 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:12.653637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e77c6-b4c1-40ca-beca-41429a1d7447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:12.731240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:12.740180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e77c6-b4c1-40ca-beca-41429a1d7447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:12.741877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e77c6-b4c1-40ca-beca-41429a1d7447 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:12.852949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 622/1241] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:17:12 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:17:12.859714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76261c-e4bc-479c-b3b9-77bcb0d1b4e8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:12.895901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:12.985319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76261c-e4bc-479c-b3b9-77bcb0d1b4e8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:13.024331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b26b7f-14d8-41fc-95af-ffbad7a3f41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:13.025277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b26b7f-14d8-41fc-95af-ffbad7a3f41e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:13.025685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b26b7f-14d8-41fc-95af-ffbad7a3f41e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:13.026090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b26b7f-14d8-41fc-95af-ffbad7a3f41e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:13.037487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b26b7f-14d8-41fc-95af-ffbad7a3f41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:13.039312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b26b7f-14d8-41fc-95af-ffbad7a3f41e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-45b26b7f-14d8-41fc-95af-ffbad7a3f41e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:13.060579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:13.061596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:13.062573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:13.062573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:13.062573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:13.062573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:13.062573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 620/1242] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:17:13.068161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e77c6-b4c1-40ca-beca-41429a1d7447 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:13.183088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:13.189352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e77c6-b4c1-40ca-beca-41429a1d7447 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:13.234677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3541b7d-4214-49ec-8b92-bffafae1d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:13.235413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3541b7d-4214-49ec-8b92-bffafae1d217 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:13.235664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3541b7d-4214-49ec-8b92-bffafae1d217 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:13.235948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3541b7d-4214-49ec-8b92-bffafae1d217 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:13.237288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3541b7d-4214-49ec-8b92-bffafae1d217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:13.237604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3541b7d-4214-49ec-8b92-bffafae1d217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:13.239979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3541b7d-4214-49ec-8b92-bffafae1d217 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:13.250987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 623/1243] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:13.258228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b26b7f-14d8-41fc-95af-ffbad7a3f41e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:13.361095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:13.386761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b26b7f-14d8-41fc-95af-ffbad7a3f41e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:13.422222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800d171-0c16-4c0f-a454-e53ca47c7e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:13.423016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800d171-0c16-4c0f-a454-e53ca47c7e8e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:13.423303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800d171-0c16-4c0f-a454-e53ca47c7e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:13.423607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800d171-0c16-4c0f-a454-e53ca47c7e8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:13.431058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800d171-0c16-4c0f-a454-e53ca47c7e8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:13.432538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800d171-0c16-4c0f-a454-e53ca47c7e8e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-0800d171-0c16-4c0f-a454-e53ca47c7e8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:17:13.446288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:13.448357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:13.450199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:17:13.450199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:17:13.450199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:17:13.450199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:17:13.450199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:17:13.450199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:17:13.450199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:13.450199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:13.450199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 621/1244] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:13.453609 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3541b7d-4214-49ec-8b92-bffafae1d217 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:13.563109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3541b7d-4214-49ec-8b92-bffafae1d217 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:13.602906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcbd10-3965-4ad1-99a2-cc27bec0b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:13.603822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcbd10-3965-4ad1-99a2-cc27bec0b54e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:13.604092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcbd10-3965-4ad1-99a2-cc27bec0b54e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:13.604365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcbd10-3965-4ad1-99a2-cc27bec0b54e None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:13.605153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcbd10-3965-4ad1-99a2-cc27bec0b54e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:13.605463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcbd10-3965-4ad1-99a2-cc27bec0b54e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:13.606905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcbd10-3965-4ad1-99a2-cc27bec0b54e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:13.620219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 624/1245] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:13.626567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800d171-0c16-4c0f-a454-e53ca47c7e8e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:13.740639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800d171-0c16-4c0f-a454-e53ca47c7e8e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:13.780868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37e15c-183a-4f25-9a34-4255ff65867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:13.781736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37e15c-183a-4f25-9a34-4255ff65867a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:13.782247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37e15c-183a-4f25-9a34-4255ff65867a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:13.782522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37e15c-183a-4f25-9a34-4255ff65867a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:13.783640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37e15c-183a-4f25-9a34-4255ff65867a None admin] RBAC: Adding query filter params (role.id=32d5f0d8a0564b0286e98637266edf11, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=88e5d3ba49164f55a063aa60643bd421) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:13.784092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37e15c-183a-4f25-9a34-4255ff65867a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:13.785934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37e15c-183a-4f25-9a34-4255ff65867a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:13.793588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 622/1246] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:17:13 2022] GET /identity/v3/role_assignments?user.id=88e5d3ba49164f55a063aa60643bd421&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=32d5f0d8a0564b0286e98637266edf11 => generated 610 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:16.326324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c26f8-a21f-489a-9664-88772c018997 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:16.326929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c26f8-a21f-489a-9664-88772c018997 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:16.326929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c26f8-a21f-489a-9664-88772c018997 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:16.328293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 625/1247] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:17:16.334210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76aa93-d5d2-4525-8190-6760d9612ee9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:16.334653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76aa93-d5d2-4525-8190-6760d9612ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:16.334777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76aa93-d5d2-4525-8190-6760d9612ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:16.340157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:16.356680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2a76aa93-d5d2-4525-8190-6760d9612ee9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:16.357897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2a76aa93-d5d2-4525-8190-6760d9612ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:16.444447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 623/1248] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:16 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:17:16.471667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c26f8-a21f-489a-9664-88772c018997 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:16.494460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:16.599499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c26f8-a21f-489a-9664-88772c018997 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:16.637750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653363c2-d962-4dec-bef5-f45d6d761f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:16.638566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653363c2-d962-4dec-bef5-f45d6d761f55 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:16.638838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653363c2-d962-4dec-bef5-f45d6d761f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:16.639138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653363c2-d962-4dec-bef5-f45d6d761f55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:16.650900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653363c2-d962-4dec-bef5-f45d6d761f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-653363c2-d962-4dec-bef5-f45d6d761f55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:17:16.659123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:16.660334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:16.665273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 626/1249] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:17:16.666691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76aa93-d5d2-4525-8190-6760d9612ee9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:16.783155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76aa93-d5d2-4525-8190-6760d9612ee9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:16.818968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:16.825669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f536c-2de5-4919-9cc0-e73cf951d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:16.826341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f536c-2de5-4919-9cc0-e73cf951d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:16.826619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f536c-2de5-4919-9cc0-e73cf951d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:16.827044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f536c-2de5-4919-9cc0-e73cf951d4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:16.828083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f536c-2de5-4919-9cc0-e73cf951d4f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:16.828448 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f536c-2de5-4919-9cc0-e73cf951d4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:16.830863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f536c-2de5-4919-9cc0-e73cf951d4f1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:16.846572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 624/1250] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:17:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:16.847988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653363c2-d962-4dec-bef5-f45d6d761f55 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:16.938669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:16.975423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653363c2-d962-4dec-bef5-f45d6d761f55 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:17.014719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cb571-abcc-4ebc-a51b-f17841090d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:17.015498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cb571-abcc-4ebc-a51b-f17841090d6e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:17.015811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cb571-abcc-4ebc-a51b-f17841090d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:17.016090 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cb571-abcc-4ebc-a51b-f17841090d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:17.030389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cb571-abcc-4ebc-a51b-f17841090d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:17.031936 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cb571-abcc-4ebc-a51b-f17841090d6e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-480cb571-abcc-4ebc-a51b-f17841090d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:17.051107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:17.052357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:17.053578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:17.053578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:17.053578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:17.053578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:17.053578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 627/1251] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:17.058899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f536c-2de5-4919-9cc0-e73cf951d4f1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:17.173241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f536c-2de5-4919-9cc0-e73cf951d4f1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:17.217036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b041e5-690a-4d0d-9111-58fe2b722f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:17.217737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b041e5-690a-4d0d-9111-58fe2b722f83 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:17.218089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b041e5-690a-4d0d-9111-58fe2b722f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:17.218332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b041e5-690a-4d0d-9111-58fe2b722f83 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:17.220736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b041e5-690a-4d0d-9111-58fe2b722f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:17.220736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b041e5-690a-4d0d-9111-58fe2b722f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:17.221084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b041e5-690a-4d0d-9111-58fe2b722f83 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:17.234481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 625/1252] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:17.240509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cb571-abcc-4ebc-a51b-f17841090d6e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:17.369775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cb571-abcc-4ebc-a51b-f17841090d6e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:17.402855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:17.412520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084bbfe-46e7-496e-ae1a-54196820bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:17.413593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084bbfe-46e7-496e-ae1a-54196820bb00 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:17.414026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084bbfe-46e7-496e-ae1a-54196820bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:17.414464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084bbfe-46e7-496e-ae1a-54196820bb00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:17.424996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084bbfe-46e7-496e-ae1a-54196820bb00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:17.426498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084bbfe-46e7-496e-ae1a-54196820bb00 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-3084bbfe-46e7-496e-ae1a-54196820bb00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:17:17.443162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:17.444800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:17.445784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 628/1253] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:17.450358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b041e5-690a-4d0d-9111-58fe2b722f83 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:17.511714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:17.561813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b041e5-690a-4d0d-9111-58fe2b722f83 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:17.599203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e755-386a-4be4-a725-29e403ab2cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:17.600005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e755-386a-4be4-a725-29e403ab2cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:17.600335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e755-386a-4be4-a725-29e403ab2cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:17.600656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e755-386a-4be4-a725-29e403ab2cb0 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:17.601668 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566e755-386a-4be4-a725-29e403ab2cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:17.602003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566e755-386a-4be4-a725-29e403ab2cb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:17.604000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566e755-386a-4be4-a725-29e403ab2cb0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:17.623929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 626/1254] 10.222.0.112 () {56 vars in 1148 bytes} [Fri Jun 3 16:17:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:17:17.631203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084bbfe-46e7-496e-ae1a-54196820bb00 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:17.757970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084bbfe-46e7-496e-ae1a-54196820bb00 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:17.794399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ac7d-239e-451b-bdfe-e66f6f77798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:17.795132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ac7d-239e-451b-bdfe-e66f6f77798d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:17.795480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ac7d-239e-451b-bdfe-e66f6f77798d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:17.795793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ac7d-239e-451b-bdfe-e66f6f77798d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:17.865284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:17.879538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280ac7d-239e-451b-bdfe-e66f6f77798d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:17.881107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280ac7d-239e-451b-bdfe-e66f6f77798d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:18.016008 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 629/1255] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:17:17 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:17:18.023158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e755-386a-4be4-a725-29e403ab2cb0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:18.144894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e755-386a-4be4-a725-29e403ab2cb0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:18.162814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:18.190041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c4d1-4c9c-47ea-a214-e3e2d622353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:18.191021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c4d1-4c9c-47ea-a214-e3e2d622353c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:18.191352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c4d1-4c9c-47ea-a214-e3e2d622353c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:18.191630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c4d1-4c9c-47ea-a214-e3e2d622353c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:18.202962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00c4d1-4c9c-47ea-a214-e3e2d622353c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:18.204576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00c4d1-4c9c-47ea-a214-e3e2d622353c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ef00c4d1-4c9c-47ea-a214-e3e2d622353c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:18.228520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:18.230346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:18.232234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:18.232234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:18.232234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:18.232234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:18.232234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 627/1256] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:18.235992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ac7d-239e-451b-bdfe-e66f6f77798d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:18.331084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:18.347998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ac7d-239e-451b-bdfe-e66f6f77798d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:18.385142 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadfce1-3091-451f-b77d-1a6db443ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:18.385864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadfce1-3091-451f-b77d-1a6db443ff39 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:18.386080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadfce1-3091-451f-b77d-1a6db443ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:18.386460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadfce1-3091-451f-b77d-1a6db443ff39 None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:18.387494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadfce1-3091-451f-b77d-1a6db443ff39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:18.387863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadfce1-3091-451f-b77d-1a6db443ff39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:18.389266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadfce1-3091-451f-b77d-1a6db443ff39 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:18.403445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 630/1257] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:18.410390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c4d1-4c9c-47ea-a214-e3e2d622353c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:18.536630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c4d1-4c9c-47ea-a214-e3e2d622353c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:18.574747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8f01a-f0ef-476d-96d5-f89418e82007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:18.575607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8f01a-f0ef-476d-96d5-f89418e82007 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:18.575850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8f01a-f0ef-476d-96d5-f89418e82007 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:18.576128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8f01a-f0ef-476d-96d5-f89418e82007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:18.583905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8f01a-f0ef-476d-96d5-f89418e82007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:18.585398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8f01a-f0ef-476d-96d5-f89418e82007 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d5b8f01a-f0ef-476d-96d5-f89418e82007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:17:18.600404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:18.601964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:18.602913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:17:18.602913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:17:18.602913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:17:18.602913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:17:18.602913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:17:18.602913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:17:18.602913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:18.602913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:18.602913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 628/1258] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:17:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:18.608464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadfce1-3091-451f-b77d-1a6db443ff39 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:18.732719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadfce1-3091-451f-b77d-1a6db443ff39 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:18.772031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a951b08-807a-4070-87f3-b3b388e2a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:18.772922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a951b08-807a-4070-87f3-b3b388e2a829 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:18.773094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a951b08-807a-4070-87f3-b3b388e2a829 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:18.773230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a951b08-807a-4070-87f3-b3b388e2a829 None admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:18.774263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a951b08-807a-4070-87f3-b3b388e2a829 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:18.774527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a951b08-807a-4070-87f3-b3b388e2a829 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:18.776150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a951b08-807a-4070-87f3-b3b388e2a829 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:18.790091 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 631/1259] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:18.797323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8f01a-f0ef-476d-96d5-f89418e82007 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:18.835303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:18.928007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8f01a-f0ef-476d-96d5-f89418e82007 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:18.971676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05884b0-b81e-44f3-80a3-0d5a56cf54d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:18.973040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05884b0-b81e-44f3-80a3-0d5a56cf54d3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:18.973695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05884b0-b81e-44f3-80a3-0d5a56cf54d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:18.974264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05884b0-b81e-44f3-80a3-0d5a56cf54d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:18.976361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05884b0-b81e-44f3-80a3-0d5a56cf54d3 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=88e5d3ba49164f55a063aa60643bd421) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:18.977047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05884b0-b81e-44f3-80a3-0d5a56cf54d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:18.979260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05884b0-b81e-44f3-80a3-0d5a56cf54d3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:18.987703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 629/1260] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:17:18 2022] GET /identity/v3/role_assignments?user.id=88e5d3ba49164f55a063aa60643bd421&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:21.355922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042c59-5545-490c-b6f0-e1e3d796ba06 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:21.356514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042c59-5545-490c-b6f0-e1e3d796ba06 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:21.356514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042c59-5545-490c-b6f0-e1e3d796ba06 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:21.357892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 632/1261] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:17:21.364095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa18d0a-ce27-4f94-8ac7-5339a43fe62f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:21.364661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa18d0a-ce27-4f94-8ac7-5339a43fe62f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:21.364773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa18d0a-ce27-4f94-8ac7-5339a43fe62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:21.382853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9fa18d0a-ce27-4f94-8ac7-5339a43fe62f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:21.384244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9fa18d0a-ce27-4f94-8ac7-5339a43fe62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:21.458592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 630/1262] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:21 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:17:21.481590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042c59-5545-490c-b6f0-e1e3d796ba06 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:21.493327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:21.594328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042c59-5545-490c-b6f0-e1e3d796ba06 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:21.631894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1a2e2-410b-4294-9007-faf9e9bd8aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:21.632697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1a2e2-410b-4294-9007-faf9e9bd8aef None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:21.633118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1a2e2-410b-4294-9007-faf9e9bd8aef None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:21.633436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1a2e2-410b-4294-9007-faf9e9bd8aef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:21.644452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1a2e2-410b-4294-9007-faf9e9bd8aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-00f1a2e2-410b-4294-9007-faf9e9bd8aef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:17:21.652138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:21.653355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:21.654323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 633/1263] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:21.659692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa18d0a-ce27-4f94-8ac7-5339a43fe62f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:21.678904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:21.766552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa18d0a-ce27-4f94-8ac7-5339a43fe62f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:21.800386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc14fee-a4c7-48bd-9403-2c43b88b81bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:21.801031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc14fee-a4c7-48bd-9403-2c43b88b81bd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:21.801309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc14fee-a4c7-48bd-9403-2c43b88b81bd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:21.801579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc14fee-a4c7-48bd-9403-2c43b88b81bd None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:21.802312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc14fee-a4c7-48bd-9403-2c43b88b81bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:21.802613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc14fee-a4c7-48bd-9403-2c43b88b81bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:21.804003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc14fee-a4c7-48bd-9403-2c43b88b81bd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:21.811930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 631/1264] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:17:21 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:21.818423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1a2e2-410b-4294-9007-faf9e9bd8aef None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:21.884079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:21.917110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1a2e2-410b-4294-9007-faf9e9bd8aef None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:21.957876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf8244-55eb-4953-ab09-777614df6b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:21.959094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf8244-55eb-4953-ab09-777614df6b20 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:21.959592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf8244-55eb-4953-ab09-777614df6b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:21.959887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf8244-55eb-4953-ab09-777614df6b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:21.974823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf8244-55eb-4953-ab09-777614df6b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:21.976420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf8244-55eb-4953-ab09-777614df6b20 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-5bcf8244-55eb-4953-ab09-777614df6b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:21.995164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:21.996653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:21.997991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:21.997991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:21.997991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:21.997991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:21.997991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 634/1265] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:22.002651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc14fee-a4c7-48bd-9403-2c43b88b81bd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:22.089359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:22.108501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc14fee-a4c7-48bd-9403-2c43b88b81bd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:22.143918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b721104-40d0-40eb-999c-d2367e43ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:22.144578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721104-40d0-40eb-999c-d2367e43ac37 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:22.144864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721104-40d0-40eb-999c-d2367e43ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:22.145142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721104-40d0-40eb-999c-d2367e43ac37 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:22.145866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721104-40d0-40eb-999c-d2367e43ac37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:22.146175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721104-40d0-40eb-999c-d2367e43ac37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:22.147535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721104-40d0-40eb-999c-d2367e43ac37 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:22.160169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 632/1266] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:22.165555 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf8244-55eb-4953-ab09-777614df6b20 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:22.265722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf8244-55eb-4953-ab09-777614df6b20 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:22.285556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:22.299073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7c61-a904-4504-872f-ec7a82cd9a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:22.299890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7c61-a904-4504-872f-ec7a82cd9a53 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:22.300170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7c61-a904-4504-872f-ec7a82cd9a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:22.300441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7c61-a904-4504-872f-ec7a82cd9a53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:22.307708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b7c61-a904-4504-872f-ec7a82cd9a53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:22.309147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b7c61-a904-4504-872f-ec7a82cd9a53 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-632b7c61-a904-4504-872f-ec7a82cd9a53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:17:22.323138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:22.324321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:22.325521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:22.327707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 635/1267] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:22.330626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b721104-40d0-40eb-999c-d2367e43ac37 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:22.434805 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b721104-40d0-40eb-999c-d2367e43ac37 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:22.472048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091501e4-e22e-4f7f-836d-3dd166878c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:22.472726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091501e4-e22e-4f7f-836d-3dd166878c9c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:22.473038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091501e4-e22e-4f7f-836d-3dd166878c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:22.473319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091501e4-e22e-4f7f-836d-3dd166878c9c None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:22.474170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091501e4-e22e-4f7f-836d-3dd166878c9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:22.474481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091501e4-e22e-4f7f-836d-3dd166878c9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:22.475978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091501e4-e22e-4f7f-836d-3dd166878c9c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:22.486629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:22.496185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 633/1268] 10.222.0.112 () {56 vars in 1148 bytes} [Fri Jun 3 16:17:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:22.502220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7c61-a904-4504-872f-ec7a82cd9a53 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:22.605821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7c61-a904-4504-872f-ec7a82cd9a53 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:22.640116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dceaa-5cac-4119-8d34-75cf75511083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:22.640912 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dceaa-5cac-4119-8d34-75cf75511083 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:22.641201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dceaa-5cac-4119-8d34-75cf75511083 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:22.641476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dceaa-5cac-4119-8d34-75cf75511083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:22.653145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dceaa-5cac-4119-8d34-75cf75511083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:22.654613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5dceaa-5cac-4119-8d34-75cf75511083 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-ea5dceaa-5cac-4119-8d34-75cf75511083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:22.672481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:22.673647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:22.674954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:22.674954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:22.674954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:22.674954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:22.674954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 636/1269] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:22.679493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091501e4-e22e-4f7f-836d-3dd166878c9c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:22.781534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091501e4-e22e-4f7f-836d-3dd166878c9c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:22.815242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7a82-874b-4649-91c4-cfd5eee519eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:22.815936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7a82-874b-4649-91c4-cfd5eee519eb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:22.816222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7a82-874b-4649-91c4-cfd5eee519eb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:22.816497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d7a82-874b-4649-91c4-cfd5eee519eb None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:22.817222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d7a82-874b-4649-91c4-cfd5eee519eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:22.817531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d7a82-874b-4649-91c4-cfd5eee519eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:22.818906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d7a82-874b-4649-91c4-cfd5eee519eb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:22.831445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 634/1270] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:22.837331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dceaa-5cac-4119-8d34-75cf75511083 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:22.871092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:22.946816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dceaa-5cac-4119-8d34-75cf75511083 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:22.987633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7ba05-1cc8-4ce6-92f8-6e8aab36621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:22.988424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7ba05-1cc8-4ce6-92f8-6e8aab36621e None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:22.988708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7ba05-1cc8-4ce6-92f8-6e8aab36621e None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:22.988983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7ba05-1cc8-4ce6-92f8-6e8aab36621e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:22.996120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7ba05-1cc8-4ce6-92f8-6e8aab36621e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:22.997594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7ba05-1cc8-4ce6-92f8-6e8aab36621e None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-8cd7ba05-1cc8-4ce6-92f8-6e8aab36621e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:17:23.013273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:23.014390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:23.015769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:17:23.015769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:17:23.015769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:17:23.015769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:17:23.015769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:17:23.015769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:17:23.015769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:23.015769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:23.015769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 637/1271] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:23.020914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7a82-874b-4649-91c4-cfd5eee519eb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:23.083035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:23.124450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d7a82-874b-4649-91c4-cfd5eee519eb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:23.160534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2ec9c-9453-4e8e-baa2-671390ea818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:23.161197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ec9c-9453-4e8e-baa2-671390ea818d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:23.161483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ec9c-9453-4e8e-baa2-671390ea818d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:23.161763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2ec9c-9453-4e8e-baa2-671390ea818d None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:23.162552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2ec9c-9453-4e8e-baa2-671390ea818d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:23.162862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2ec9c-9453-4e8e-baa2-671390ea818d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:23.164346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2ec9c-9453-4e8e-baa2-671390ea818d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:23.177428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 635/1272] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:23.183298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7ba05-1cc8-4ce6-92f8-6e8aab36621e None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:23.283623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:23.292947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7ba05-1cc8-4ce6-92f8-6e8aab36621e None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:23.327160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dcba5-7b61-4a40-a845-dbbc367065ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:23.328074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dcba5-7b61-4a40-a845-dbbc367065ed None admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:23.328439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dcba5-7b61-4a40-a845-dbbc367065ed None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:23.328691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dcba5-7b61-4a40-a845-dbbc367065ed None admin] PATH_INFO: `/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/88e5d3ba49164f55a063aa60643bd421/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:23.330653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dcba5-7b61-4a40-a845-dbbc367065ed None admin] RBAC: Authorizing `identity:create_grant(project_id=555515ae5eb24b5fa77ae7712f0470ea, user_id=88e5d3ba49164f55a063aa60643bd421, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:23.332233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dcba5-7b61-4a40-a845-dbbc367065ed None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:23.345671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 638/1273] 10.222.0.112 () {58 vars in 1444 bytes} [Fri Jun 3 16:17:23 2022] PUT /identity/v3/projects/555515ae5eb24b5fa77ae7712f0470ea/users/88e5d3ba49164f55a063aa60643bd421/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:17:25.574732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf66e7-76bd-48c6-b44a-ca0c33eda4c9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:25.575244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf66e7-76bd-48c6-b44a-ca0c33eda4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:25.575244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf66e7-76bd-48c6-b44a-ca0c33eda4c9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:25.576611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 636/1274] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:17:25.581962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236f17e-8c18-4f23-b974-22e07cb2b6b9 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:25.582376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236f17e-8c18-4f23-b974-22e07cb2b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:25.582515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236f17e-8c18-4f23-b974-22e07cb2b6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:25.599369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3236f17e-8c18-4f23-b974-22e07cb2b6b9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:25.600591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3236f17e-8c18-4f23-b974-22e07cb2b6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:25.666962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 639/1275] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:25 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:17:25.691205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf66e7-76bd-48c6-b44a-ca0c33eda4c9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:25.790061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf66e7-76bd-48c6-b44a-ca0c33eda4c9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:25.807288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:25.823418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed69cc7-1803-4ad8-bbb1-d86034037cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:25.824252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed69cc7-1803-4ad8-bbb1-d86034037cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:25.824531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed69cc7-1803-4ad8-bbb1-d86034037cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:25.824851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed69cc7-1803-4ad8-bbb1-d86034037cd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:25.834445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed69cc7-1803-4ad8-bbb1-d86034037cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2ed69cc7-1803-4ad8-bbb1-d86034037cd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 16:17:25.841985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:25.842962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:25.843977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 637/1276] 10.222.0.112 () {56 vars in 1101 bytes} [Fri Jun 3 16:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:25.849743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236f17e-8c18-4f23-b974-22e07cb2b6b9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:25.927214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:25.949660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236f17e-8c18-4f23-b974-22e07cb2b6b9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:25.990212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec1793-f03f-46b2-b6d4-45fcd7e4cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:25.990937 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec1793-f03f-46b2-b6d4-45fcd7e4cc31 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:25.991230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec1793-f03f-46b2-b6d4-45fcd7e4cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:25.991575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec1793-f03f-46b2-b6d4-45fcd7e4cc31 None admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:25.992424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec1793-f03f-46b2-b6d4-45fcd7e4cc31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:25.992737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec1793-f03f-46b2-b6d4-45fcd7e4cc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:25.994261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec1793-f03f-46b2-b6d4-45fcd7e4cc31 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:26.003373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 640/1277] 10.222.0.112 () {56 vars in 1104 bytes} [Fri Jun 3 16:17:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:26.009164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed69cc7-1803-4ad8-bbb1-d86034037cd9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:26.109747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed69cc7-1803-4ad8-bbb1-d86034037cd9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:26.143485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7465e51-546c-46b7-9dc2-863679c0839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:26.144306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7465e51-546c-46b7-9dc2-863679c0839c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:26.144596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7465e51-546c-46b7-9dc2-863679c0839c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:26.144872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7465e51-546c-46b7-9dc2-863679c0839c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:26.156344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7465e51-546c-46b7-9dc2-863679c0839c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:26.158565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7465e51-546c-46b7-9dc2-863679c0839c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b7465e51-546c-46b7-9dc2-863679c0839c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:26.179570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:26.180623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:26.181738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:26.181738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:26.181738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:26.181738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:26.181738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 638/1278] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:26.186972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec1793-f03f-46b2-b6d4-45fcd7e4cc31 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:26.285615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec1793-f03f-46b2-b6d4-45fcd7e4cc31 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:26.318174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64066a61-4698-4ca6-afeb-82ded6e8098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:26.318828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64066a61-4698-4ca6-afeb-82ded6e8098d None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:26.319112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64066a61-4698-4ca6-afeb-82ded6e8098d None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:26.319390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64066a61-4698-4ca6-afeb-82ded6e8098d None admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:26.320136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64066a61-4698-4ca6-afeb-82ded6e8098d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:26.320446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64066a61-4698-4ca6-afeb-82ded6e8098d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:26.321813 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64066a61-4698-4ca6-afeb-82ded6e8098d None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:26.333849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 641/1279] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:26.339789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7465e51-546c-46b7-9dc2-863679c0839c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:26.370210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:26.437437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7465e51-546c-46b7-9dc2-863679c0839c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:26.470203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe51e0-cb30-4012-b423-2e879fdcc10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:26.470991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe51e0-cb30-4012-b423-2e879fdcc10f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:26.471266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe51e0-cb30-4012-b423-2e879fdcc10f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:26.471535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe51e0-cb30-4012-b423-2e879fdcc10f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:26.479266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe51e0-cb30-4012-b423-2e879fdcc10f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:26.480757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe51e0-cb30-4012-b423-2e879fdcc10f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8fbe51e0-cb30-4012-b423-2e879fdcc10f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 16:17:26.494696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:26.495886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:26.497063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 639/1280] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:26.502394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64066a61-4698-4ca6-afeb-82ded6e8098d None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:26.506189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:26.599477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64066a61-4698-4ca6-afeb-82ded6e8098d None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:26.632833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c66b66-560b-408f-9fc1-9d408cd1dcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:26.633428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c66b66-560b-408f-9fc1-9d408cd1dcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:26.633713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c66b66-560b-408f-9fc1-9d408cd1dcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:26.633988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c66b66-560b-408f-9fc1-9d408cd1dcb5 None admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:26.634823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c66b66-560b-408f-9fc1-9d408cd1dcb5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:26.635767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c66b66-560b-408f-9fc1-9d408cd1dcb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:26.636610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c66b66-560b-408f-9fc1-9d408cd1dcb5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:26.654611 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 642/1281] 10.222.0.112 () {56 vars in 1148 bytes} [Fri Jun 3 16:17:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:26.660333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe51e0-cb30-4012-b423-2e879fdcc10f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:26.750406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:26.760647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe51e0-cb30-4012-b423-2e879fdcc10f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:26.793654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa95c8-f29a-4271-b595-8f3572976f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:26.794284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa95c8-f29a-4271-b595-8f3572976f7e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:26.794571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa95c8-f29a-4271-b595-8f3572976f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:26.794848 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa95c8-f29a-4271-b595-8f3572976f7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:26.859576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa95c8-f29a-4271-b595-8f3572976f7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:26.861584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa95c8-f29a-4271-b595-8f3572976f7e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:26.948703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:26.960680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 640/1282] 10.222.0.112 () {58 vars in 1287 bytes} [Fri Jun 3 16:17:26 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 16:17:26.966604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c66b66-560b-408f-9fc1-9d408cd1dcb5 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:27.027059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:27.065770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c66b66-560b-408f-9fc1-9d408cd1dcb5 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:27.098379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c728f9-c91d-4236-a1a7-9f0916efe624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:27.099165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c728f9-c91d-4236-a1a7-9f0916efe624 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:27.099444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c728f9-c91d-4236-a1a7-9f0916efe624 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:27.099963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c728f9-c91d-4236-a1a7-9f0916efe624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:27.111646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c728f9-c91d-4236-a1a7-9f0916efe624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:27.113084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c728f9-c91d-4236-a1a7-9f0916efe624 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-46c728f9-c91d-4236-a1a7-9f0916efe624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 16:17:27.130546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:27.131681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:27.133010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 16:17:27.133010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 16:17:27.133010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 16:17:27.133010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:27.133010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 643/1283] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:27.137440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa95c8-f29a-4271-b595-8f3572976f7e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:27.237954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa95c8-f29a-4271-b595-8f3572976f7e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:27.272113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5afb0-632e-4cd2-a0fb-29c0f901326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:27.272769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5afb0-632e-4cd2-a0fb-29c0f901326e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:27.273055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5afb0-632e-4cd2-a0fb-29c0f901326e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:27.273342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5afb0-632e-4cd2-a0fb-29c0f901326e None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:27.274060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5afb0-632e-4cd2-a0fb-29c0f901326e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:27.274369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5afb0-632e-4cd2-a0fb-29c0f901326e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:27.275773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5afb0-632e-4cd2-a0fb-29c0f901326e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:27.286675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 641/1284] 10.222.0.112 () {56 vars in 1114 bytes} [Fri Jun 3 16:17:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:27.292385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c728f9-c91d-4236-a1a7-9f0916efe624 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:27.391617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c728f9-c91d-4236-a1a7-9f0916efe624 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:27.405885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:27.425598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce0e1-1eb7-4702-ad7e-b8867adca060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:27.426383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce0e1-1eb7-4702-ad7e-b8867adca060 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:27.426666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce0e1-1eb7-4702-ad7e-b8867adca060 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:27.426943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ce0e1-1eb7-4702-ad7e-b8867adca060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:27.433559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ce0e1-1eb7-4702-ad7e-b8867adca060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:27.435009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ce0e1-1eb7-4702-ad7e-b8867adca060 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application [None req-8a9ce0e1-1eb7-4702-ad7e-b8867adca060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 16:17:27.449068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:27.450158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:27.451280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 16:17:27.451280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 16:17:27.451280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 16:17:27.451280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 16:17:27.451280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 16:17:27.451280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 16:17:27.451280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 16:17:27.451280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: ERROR keystone.server.flask.application Jun 03 16:17:27.451280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 644/1285] 10.222.0.112 () {56 vars in 1116 bytes} [Fri Jun 3 16:17:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:27.456863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5afb0-632e-4cd2-a0fb-29c0f901326e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:27.505669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:27.554209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5afb0-632e-4cd2-a0fb-29c0f901326e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:27.585991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab7f6f-efe6-425c-9c8d-514fb0a9ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:27.586633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab7f6f-efe6-425c-9c8d-514fb0a9ae31 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:27.586977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab7f6f-efe6-425c-9c8d-514fb0a9ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:27.587172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab7f6f-efe6-425c-9c8d-514fb0a9ae31 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:27.587974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab7f6f-efe6-425c-9c8d-514fb0a9ae31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:27.588278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab7f6f-efe6-425c-9c8d-514fb0a9ae31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:27.589697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab7f6f-efe6-425c-9c8d-514fb0a9ae31 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:27.601240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 642/1286] 10.222.0.112 () {56 vars in 1153 bytes} [Fri Jun 3 16:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:27.607542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce0e1-1eb7-4702-ad7e-b8867adca060 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:27.712803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ce0e1-1eb7-4702-ad7e-b8867adca060 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:27.746039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c00db6-a4f3-4948-b123-a3dee03164e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:27.746683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c00db6-a4f3-4948-b123-a3dee03164e1 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:27.746966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c00db6-a4f3-4948-b123-a3dee03164e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:27.747244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c00db6-a4f3-4948-b123-a3dee03164e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:27.748099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c00db6-a4f3-4948-b123-a3dee03164e1 None admin] RBAC: Adding query filter params (role.id=f87e080ffaf045a5a133bedb12eb53cd, scope.project.id=555515ae5eb24b5fa77ae7712f0470ea, user.id=88e5d3ba49164f55a063aa60643bd421) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:27.748415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c00db6-a4f3-4948-b123-a3dee03164e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:27.749848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c00db6-a4f3-4948-b123-a3dee03164e1 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:27.756332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 645/1287] 10.222.0.112 () {56 vars in 1379 bytes} [Fri Jun 3 16:17:27 2022] GET /identity/v3/role_assignments?user.id=88e5d3ba49164f55a063aa60643bd421&scope.project.id=555515ae5eb24b5fa77ae7712f0470ea&role.id=f87e080ffaf045a5a133bedb12eb53cd => generated 610 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:30.023440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ebe6c-8b7f-4c16-9719-01855e9f3408 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:30.024078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ebe6c-8b7f-4c16-9719-01855e9f3408 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:30.024078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ebe6c-8b7f-4c16-9719-01855e9f3408 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:30.025391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 643/1288] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:17:30.030671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3c83b-69ff-4415-8138-3c9dc383f38f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:30.031105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3c83b-69ff-4415-8138-3c9dc383f38f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:30.031228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3c83b-69ff-4415-8138-3c9dc383f38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:30.048842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-16c3c83b-69ff-4415-8138-3c9dc383f38f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:30.050040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-16c3c83b-69ff-4415-8138-3c9dc383f38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:30.081230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:30.119834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 646/1289] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:30 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:17:30.142684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ebe6c-8b7f-4c16-9719-01855e9f3408 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:30.249768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ebe6c-8b7f-4c16-9719-01855e9f3408 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:30.260258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:30.283822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea677c-a02f-47df-9704-bca9ed1d20b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:30.284542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea677c-a02f-47df-9704-bca9ed1d20b6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:30.284824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea677c-a02f-47df-9704-bca9ed1d20b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:30.285098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea677c-a02f-47df-9704-bca9ed1d20b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:30.285748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea677c-a02f-47df-9704-bca9ed1d20b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:30.287114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea677c-a02f-47df-9704-bca9ed1d20b6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-61ea677c-a02f-47df-9704-bca9ed1d20b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:30.299258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:30.300611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:30.301595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 644/1290] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:17:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:30.306608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3c83b-69ff-4415-8138-3c9dc383f38f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:30.402724 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3c83b-69ff-4415-8138-3c9dc383f38f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:30.435945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f6b44-aebc-4517-aa56-cc0e68276ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:30.436601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f6b44-aebc-4517-aa56-cc0e68276ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:30.436883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f6b44-aebc-4517-aa56-cc0e68276ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:30.437156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f6b44-aebc-4517-aa56-cc0e68276ee2 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:30.437856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f6b44-aebc-4517-aa56-cc0e68276ee2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:30.438160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f6b44-aebc-4517-aa56-cc0e68276ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:30.439584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f6b44-aebc-4517-aa56-cc0e68276ee2 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:30.444368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 647/1291] 10.222.0.112 () {56 vars in 1121 bytes} [Fri Jun 3 16:17:30 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:30.450273 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea677c-a02f-47df-9704-bca9ed1d20b6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:30.547882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea677c-a02f-47df-9704-bca9ed1d20b6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:30.579963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef49ee-98eb-4e6d-9f84-04c355249cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:30.580604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef49ee-98eb-4e6d-9f84-04c355249cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:30.580887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef49ee-98eb-4e6d-9f84-04c355249cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:30.581164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef49ee-98eb-4e6d-9f84-04c355249cb6 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:30.581861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef49ee-98eb-4e6d-9f84-04c355249cb6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:30.582165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef49ee-98eb-4e6d-9f84-04c355249cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:30.583533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef49ee-98eb-4e6d-9f84-04c355249cb6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:30.588283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 645/1292] 10.222.0.112 () {56 vars in 1121 bytes} [Fri Jun 3 16:17:30 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:32.846550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b67613-6993-4126-bfd8-48de4542704e None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:32.847113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b67613-6993-4126-bfd8-48de4542704e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:32.847113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b67613-6993-4126-bfd8-48de4542704e None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:32.848489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 648/1293] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:17:32.854056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b9c72-bbec-419f-a463-b7500eda2d77 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:32.854491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b9c72-bbec-419f-a463-b7500eda2d77 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:32.854600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b9c72-bbec-419f-a463-b7500eda2d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:32.872010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-591b9c72-bbec-419f-a463-b7500eda2d77 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:32.873210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-591b9c72-bbec-419f-a463-b7500eda2d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:32.902976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:32.941889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 646/1294] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:32 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 16:17:32.972147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b67613-6993-4126-bfd8-48de4542704e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:33.009371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:33.079020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b67613-6993-4126-bfd8-48de4542704e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:33.112626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04ae06-05cf-4607-9a34-b66f65e4f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:33.113215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04ae06-05cf-4607-9a34-b66f65e4f1cf None admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:33.113501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04ae06-05cf-4607-9a34-b66f65e4f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:33.113781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04ae06-05cf-4607-9a34-b66f65e4f1cf None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:33.114497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04ae06-05cf-4607-9a34-b66f65e4f1cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:33.115905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04ae06-05cf-4607-9a34-b66f65e4f1cf None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:33.129431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 649/1295] 10.222.0.112 () {60 vars in 1146 bytes} [Fri Jun 3 16:17:32 2022] POST /identity/v3/services => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:17:35.358120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500b89a-be26-4e84-a3d3-5424f30c4282 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:35.358688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500b89a-be26-4e84-a3d3-5424f30c4282 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:35.358688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500b89a-be26-4e84-a3d3-5424f30c4282 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:35.360103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 647/1296] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:17:35.365425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b2b4-c686-4dc9-a13d-e6d267f87864 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:35.365889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b2b4-c686-4dc9-a13d-e6d267f87864 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:35.365999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b2b4-c686-4dc9-a13d-e6d267f87864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:35.382780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d798b2b4-c686-4dc9-a13d-e6d267f87864 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:35.384010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d798b2b4-c686-4dc9-a13d-e6d267f87864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:35.463637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 650/1297] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:35 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:17:35.487115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500b89a-be26-4e84-a3d3-5424f30c4282 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:35.590767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500b89a-be26-4e84-a3d3-5424f30c4282 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:35.623762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3de859-bd65-4313-b87c-a1e0976aac0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:35.624545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3de859-bd65-4313-b87c-a1e0976aac0b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:35.624828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3de859-bd65-4313-b87c-a1e0976aac0b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:35.625102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3de859-bd65-4313-b87c-a1e0976aac0b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:35.626277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3de859-bd65-4313-b87c-a1e0976aac0b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:35.627664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3de859-bd65-4313-b87c-a1e0976aac0b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7a3de859-bd65-4313-b87c-a1e0976aac0b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:35.639248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:35.640499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:35.641369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 648/1298] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:17:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 16:17:35.647422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b2b4-c686-4dc9-a13d-e6d267f87864 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:35.665522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:35.745644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b2b4-c686-4dc9-a13d-e6d267f87864 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:35.779077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bf8d4-40cc-4b57-b21d-e660aff48980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:35.779765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bf8d4-40cc-4b57-b21d-e660aff48980 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:35.780050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bf8d4-40cc-4b57-b21d-e660aff48980 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:35.780327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bf8d4-40cc-4b57-b21d-e660aff48980 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:35.781031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bf8d4-40cc-4b57-b21d-e660aff48980 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:35.781338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bf8d4-40cc-4b57-b21d-e660aff48980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:35.782707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bf8d4-40cc-4b57-b21d-e660aff48980 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:35.787819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 651/1299] 10.222.0.112 () {56 vars in 1121 bytes} [Fri Jun 3 16:17:35 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:35.793884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3de859-bd65-4313-b87c-a1e0976aac0b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:35.825961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:35.893500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3de859-bd65-4313-b87c-a1e0976aac0b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:35.926079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33541c8c-de2a-4da2-befe-89f429e416d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:35.926715 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541c8c-de2a-4da2-befe-89f429e416d6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:35.926999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541c8c-de2a-4da2-befe-89f429e416d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:35.927274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541c8c-de2a-4da2-befe-89f429e416d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:35.928097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33541c8c-de2a-4da2-befe-89f429e416d6 None admin] RBAC: Adding query filter params (interface=public, service_id=102137ae9c6e4371b0406162e3fb2b1f, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:35.928415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33541c8c-de2a-4da2-befe-89f429e416d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:35.929795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33541c8c-de2a-4da2-befe-89f429e416d6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:35.934911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 649/1300] 10.222.0.112 () {56 vars in 1256 bytes} [Fri Jun 3 16:17:35 2022] GET /identity/v3/endpoints?service_id=102137ae9c6e4371b0406162e3fb2b1f&interface=public®ion_id=RegionOne => generated 195 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:35.941568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bf8d4-40cc-4b57-b21d-e660aff48980 None admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:36.021556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:36.039657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bf8d4-40cc-4b57-b21d-e660aff48980 None admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:36.073302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ba4ee-c5d7-4cf1-9c75-ea2187856d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:36.073949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ba4ee-c5d7-4cf1-9c75-ea2187856d5b None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:36.074227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ba4ee-c5d7-4cf1-9c75-ea2187856d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:36.074499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ba4ee-c5d7-4cf1-9c75-ea2187856d5b None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:36.075169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ba4ee-c5d7-4cf1-9c75-ea2187856d5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:36.076565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ba4ee-c5d7-4cf1-9c75-ea2187856d5b None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:36.083166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 652/1301] 10.222.0.112 () {56 vars in 1092 bytes} [Fri Jun 3 16:17:35 2022] GET /identity/v3/services => generated 2201 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:17:38.310968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c652a-5b50-4be3-8bfe-f80a62003767 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:38.311533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c652a-5b50-4be3-8bfe-f80a62003767 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:38.311533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c652a-5b50-4be3-8bfe-f80a62003767 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:38.312941 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 650/1302] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:17:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:17:38.318905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d41bb-296c-4e8b-8c4e-90675af8b715 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:38.319304 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d41bb-296c-4e8b-8c4e-90675af8b715 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:38.319463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d41bb-296c-4e8b-8c4e-90675af8b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:38.335904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-441d41bb-296c-4e8b-8c4e-90675af8b715 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:17:38.337094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-441d41bb-296c-4e8b-8c4e-90675af8b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:17:38.411950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 653/1303] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:17:38 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 16:17:38.434907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c652a-5b50-4be3-8bfe-f80a62003767 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:38.530711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:38.537828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c652a-5b50-4be3-8bfe-f80a62003767 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:38.572003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccfede-14d3-4650-8e66-79b181bdf30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:38.572791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccfede-14d3-4650-8e66-79b181bdf30c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:38.573074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccfede-14d3-4650-8e66-79b181bdf30c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:38.573348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccfede-14d3-4650-8e66-79b181bdf30c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:38.573996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccfede-14d3-4650-8e66-79b181bdf30c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:38.575383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccfede-14d3-4650-8e66-79b181bdf30c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d4ccfede-14d3-4650-8e66-79b181bdf30c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 16:17:38.587879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 16:17:38.589153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jun 03 16:17:38.590209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 651/1304] 10.222.0.112 () {56 vars in 1122 bytes} [Fri Jun 3 16:17:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 16:17:38.595504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d41bb-296c-4e8b-8c4e-90675af8b715 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:38.676373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:38.700657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d41bb-296c-4e8b-8c4e-90675af8b715 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:38.734641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc16b2-487b-4d00-944c-eeb78e0f6fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:38.735876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc16b2-487b-4d00-944c-eeb78e0f6fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:38.736161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc16b2-487b-4d00-944c-eeb78e0f6fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:38.736440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc16b2-487b-4d00-944c-eeb78e0f6fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:38.737145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc16b2-487b-4d00-944c-eeb78e0f6fe5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:17:38.737454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc16b2-487b-4d00-944c-eeb78e0f6fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:38.738831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc16b2-487b-4d00-944c-eeb78e0f6fe5 None admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:38.744129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 654/1305] 10.222.0.112 () {56 vars in 1121 bytes} [Fri Jun 3 16:17:38 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:17:38.749940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccfede-14d3-4650-8e66-79b181bdf30c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:17:38.846012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccfede-14d3-4650-8e66-79b181bdf30c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:17:38.877942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf0469-77c5-4725-ba79-30da7dbc9fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:17:38.878569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf0469-77c5-4725-ba79-30da7dbc9fe8 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:17:38.878847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf0469-77c5-4725-ba79-30da7dbc9fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:17:38.879120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf0469-77c5-4725-ba79-30da7dbc9fe8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:17:38.879889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf0469-77c5-4725-ba79-30da7dbc9fe8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:17:38.881244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf0469-77c5-4725-ba79-30da7dbc9fe8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:17:38.899216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 652/1306] 10.222.0.112 () {60 vars in 1149 bytes} [Fri Jun 3 16:17:38 2022] POST /identity/v3/endpoints => generated 333 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:17:48.740965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=30 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:48.894893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:43.647819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d67d9-48dd-4bcd-a9c6-f8480044f544 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:43.648447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d67d9-48dd-4bcd-a9c6-f8480044f544 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:43.648447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d67d9-48dd-4bcd-a9c6-f8480044f544 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:43.649761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 655/1307] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:18:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:18:43.655315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19735dc6-9ab3-4f78-8f62-8ae7db23aa73 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:43.655913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19735dc6-9ab3-4f78-8f62-8ae7db23aa73 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:43.656003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19735dc6-9ab3-4f78-8f62-8ae7db23aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:43.919067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-19735dc6-9ab3-4f78-8f62-8ae7db23aa73 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:18:43.920587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-19735dc6-9ab3-4f78-8f62-8ae7db23aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:44.073285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 653/1308] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:18:44.124294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e9ad-1dad-4793-b459-df10f6f27a2d None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:44.124954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e9ad-1dad-4793-b459-df10f6f27a2d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:44.125446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107e9ad-1dad-4793-b459-df10f6f27a2d None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:44.127624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 656/1309] 10.222.0.112 () {54 vars in 969 bytes} [Fri Jun 3 16:18:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:18:44.133964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55ca66-a927-4644-8e13-277eff0a1038 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:44.134262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55ca66-a927-4644-8e13-277eff0a1038 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:44.134546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55ca66-a927-4644-8e13-277eff0a1038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:44.389911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5c55ca66-a927-4644-8e13-277eff0a1038 None None] MFA Rules not processed for user `ed487d7f2dde42268c57a5330b6c5b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:18:44.391152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5c55ca66-a927-4644-8e13-277eff0a1038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:44.414928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:44.477382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 654/1310] 10.222.0.112 () {58 vars in 1066 bytes} [Fri Jun 3 16:18:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:18:44.487039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e9ad-1dad-4793-b459-df10f6f27a2d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:18:44.489187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d107e9ad-1dad-4793-b459-df10f6f27a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:44.609272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107e9ad-1dad-4793-b459-df10f6f27a2d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:18:44.690870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd48377-db4c-4942-8744-a1fcf8d012d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:18:44.692361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd48377-db4c-4942-8744-a1fcf8d012d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:44.692855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd48377-db4c-4942-8744-a1fcf8d012d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:44.693360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd48377-db4c-4942-8744-a1fcf8d012d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:44.695235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9bd48377-db4c-4942-8744-a1fcf8d012d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:44.760281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:44.836707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd48377-db4c-4942-8744-a1fcf8d012d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:18:44.838715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd48377-db4c-4942-8744-a1fcf8d012d7 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:18:44.882106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 657/1311] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:18:47.495452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6394cf-8c59-4840-8245-1995a584413c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:47.496014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6394cf-8c59-4840-8245-1995a584413c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:47.496014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6394cf-8c59-4840-8245-1995a584413c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:47.497370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 655/1312] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:18:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:18:47.502763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b14b9-0f76-4ccb-8189-12b264a43e54 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:47.503205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b14b9-0f76-4ccb-8189-12b264a43e54 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:47.503322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b14b9-0f76-4ccb-8189-12b264a43e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:47.572970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f64b14b9-0f76-4ccb-8189-12b264a43e54 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:18:47.574184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f64b14b9-0f76-4ccb-8189-12b264a43e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:47.673043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 658/1313] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:18:47.710940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6394cf-8c59-4840-8245-1995a584413c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:18:47.712550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ec6394cf-8c59-4840-8245-1995a584413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:47.821394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6394cf-8c59-4840-8245-1995a584413c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:18:47.895389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:47.897995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12e5de-fce4-4e31-8505-d7cee19b64e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:18:47.898686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12e5de-fce4-4e31-8505-d7cee19b64e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:47.899225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12e5de-fce4-4e31-8505-d7cee19b64e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:47.899687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12e5de-fce4-4e31-8505-d7cee19b64e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:47.901665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa12e5de-fce4-4e31-8505-d7cee19b64e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:48.017273 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12e5de-fce4-4e31-8505-d7cee19b64e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:18:48.018707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12e5de-fce4-4e31-8505-d7cee19b64e9 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:18:48.037995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 656/1314] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:18:50.615610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0fa43-5078-40f9-88e9-12816cf05820 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:50.616132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0fa43-5078-40f9-88e9-12816cf05820 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:50.616132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0fa43-5078-40f9-88e9-12816cf05820 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:50.617545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 659/1315] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:18:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:18:50.623220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922fdac-0bc0-45ea-9a84-902da60966ee None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:50.623692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922fdac-0bc0-45ea-9a84-902da60966ee None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:50.623789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922fdac-0bc0-45ea-9a84-902da60966ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:50.688272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1922fdac-0bc0-45ea-9a84-902da60966ee None None] MFA Rules not processed for user `a26d924814b24c6e9a1fa3e7eec884a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:18:50.689561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1922fdac-0bc0-45ea-9a84-902da60966ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:50.744253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:50.789884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 657/1316] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:18:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:18:50.830335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0fa43-5078-40f9-88e9-12816cf05820 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:18:50.832214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-76c0fa43-5078-40f9-88e9-12816cf05820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:50.844804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:51.072237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0fa43-5078-40f9-88e9-12816cf05820 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:18:51.145906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af326976-6e08-4545-b7ee-28b757222ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:18:51.146549 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af326976-6e08-4545-b7ee-28b757222ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:51.146836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af326976-6e08-4545-b7ee-28b757222ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:51.147106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af326976-6e08-4545-b7ee-28b757222ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:51.148793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-af326976-6e08-4545-b7ee-28b757222ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:51.212585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:51.260048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af326976-6e08-4545-b7ee-28b757222ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:18:51.261519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af326976-6e08-4545-b7ee-28b757222ab6 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:18:51.279635 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 660/1317] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:18:50 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:18:54.117050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29479-95f6-49fe-994a-12130870aeec None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:54.117569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29479-95f6-49fe-994a-12130870aeec None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:54.117569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f29479-95f6-49fe-994a-12130870aeec None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:54.118921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 658/1318] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:18:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:18:54.124828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1860-2e95-4528-88ab-1cc721212318 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:54.125277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1860-2e95-4528-88ab-1cc721212318 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:54.125374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1860-2e95-4528-88ab-1cc721212318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:54.191988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-672c1860-2e95-4528-88ab-1cc721212318 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:18:54.193208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-672c1860-2e95-4528-88ab-1cc721212318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:54.288804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 661/1319] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:18:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:18:54.351131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9be4e-ff46-42d1-9b99-7f20ed1a00d4 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:54.351415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9be4e-ff46-42d1-9b99-7f20ed1a00d4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:54.351725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9be4e-ff46-42d1-9b99-7f20ed1a00d4 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:54.353354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 659/1320] 10.222.0.112 () {54 vars in 969 bytes} [Fri Jun 3 16:18:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:18:54.359776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7812-9092-47a6-9e8e-d5c60fc520a8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:54.360068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7812-9092-47a6-9e8e-d5c60fc520a8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:54.360349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7812-9092-47a6-9e8e-d5c60fc520a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:54.380617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:54.434584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c2da7812-9092-47a6-9e8e-d5c60fc520a8 None None] MFA Rules not processed for user `ed487d7f2dde42268c57a5330b6c5b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:18:54.435853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c2da7812-9092-47a6-9e8e-d5c60fc520a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:54.510760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 662/1321] 10.222.0.112 () {58 vars in 1066 bytes} [Fri Jun 3 16:18:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:18:54.520154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9be4e-ff46-42d1-9b99-7f20ed1a00d4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:18:54.521693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-77a9be4e-ff46-42d1-9b99-7f20ed1a00d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:54.622333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9be4e-ff46-42d1-9b99-7f20ed1a00d4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:18:54.694886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb9d70-56da-4c7c-8d21-89ce5e4a83b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:18:54.695444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb9d70-56da-4c7c-8d21-89ce5e4a83b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:54.695750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb9d70-56da-4c7c-8d21-89ce5e4a83b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:54.696030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb9d70-56da-4c7c-8d21-89ce5e4a83b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:54.697658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-accb9d70-56da-4c7c-8d21-89ce5e4a83b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:54.705128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:54.804129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb9d70-56da-4c7c-8d21-89ce5e4a83b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:18:54.805552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb9d70-56da-4c7c-8d21-89ce5e4a83b0 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:18:54.823533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 660/1322] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:18:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:18:58.206222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec77c9-533f-43b5-b8ab-b347cd240e11 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:58.206769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec77c9-533f-43b5-b8ab-b347cd240e11 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:58.206883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec77c9-533f-43b5-b8ab-b347cd240e11 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:58.208205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 663/1323] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:18:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:18:58.213582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be517445-e118-4066-b5fa-e2c6ace8e35c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:58.214036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be517445-e118-4066-b5fa-e2c6ace8e35c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:58.214157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be517445-e118-4066-b5fa-e2c6ace8e35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:58.281457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-be517445-e118-4066-b5fa-e2c6ace8e35c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:18:58.282665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-be517445-e118-4066-b5fa-e2c6ace8e35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:58.351868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:58.392844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 661/1324] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:18:58.429137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec77c9-533f-43b5-b8ab-b347cd240e11 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:18:58.430632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-21ec77c9-533f-43b5-b8ab-b347cd240e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:58.534352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec77c9-533f-43b5-b8ab-b347cd240e11 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:18:58.547457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:58.612714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462ec17-bf74-416f-97a7-d0f48aca34bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:18:58.613384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ec17-bf74-416f-97a7-d0f48aca34bc service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:18:58.613666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ec17-bf74-416f-97a7-d0f48aca34bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:18:58.613942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ec17-bf74-416f-97a7-d0f48aca34bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:18:58.615780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8462ec17-bf74-416f-97a7-d0f48aca34bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:18:58.729112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462ec17-bf74-416f-97a7-d0f48aca34bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:18:58.730477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462ec17-bf74-416f-97a7-d0f48aca34bc service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:18:58.749400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 664/1325] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:01.071220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e1adf-514b-46ad-8d58-ec5382ed5d71 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:01.071900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e1adf-514b-46ad-8d58-ec5382ed5d71 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:01.071900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e1adf-514b-46ad-8d58-ec5382ed5d71 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:01.073169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 662/1326] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:01.078427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f3123-d2e8-4d74-a373-bc5f4e34cc7b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:01.078877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f3123-d2e8-4d74-a373-bc5f4e34cc7b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:01.079013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f3123-d2e8-4d74-a373-bc5f4e34cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:01.126517 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:01.145824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a70f3123-d2e8-4d74-a373-bc5f4e34cc7b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:01.147041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a70f3123-d2e8-4d74-a373-bc5f4e34cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:01.247243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 665/1327] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:01.283223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e1adf-514b-46ad-8d58-ec5382ed5d71 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:01.284795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-453e1adf-514b-46ad-8d58-ec5382ed5d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:01.388951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e1adf-514b-46ad-8d58-ec5382ed5d71 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:01.461816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d222b06-6c4d-4b68-9f2d-82353ff5e469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:01.462464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d222b06-6c4d-4b68-9f2d-82353ff5e469 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:01.462746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d222b06-6c4d-4b68-9f2d-82353ff5e469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:01.463021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d222b06-6c4d-4b68-9f2d-82353ff5e469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:01.464729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9d222b06-6c4d-4b68-9f2d-82353ff5e469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:01.481610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:01.576310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d222b06-6c4d-4b68-9f2d-82353ff5e469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:01.577797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d222b06-6c4d-4b68-9f2d-82353ff5e469 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:01.596559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 663/1328] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:03.909236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d21d9c-e4d9-4cff-8c7f-28eddda50525 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:03.909765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d21d9c-e4d9-4cff-8c7f-28eddda50525 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:03.909765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d21d9c-e4d9-4cff-8c7f-28eddda50525 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:03.911154 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 666/1329] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:03.916688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a234b-1415-4aa6-ace6-86d31d9fca7b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:03.917253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a234b-1415-4aa6-ace6-86d31d9fca7b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:03.917253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a234b-1415-4aa6-ace6-86d31d9fca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:03.982828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ff6a234b-1415-4aa6-ace6-86d31d9fca7b None None] MFA Rules not processed for user `a26d924814b24c6e9a1fa3e7eec884a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:03.984081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ff6a234b-1415-4aa6-ace6-86d31d9fca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:04.051201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:04.086930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 664/1330] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:04.125373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d21d9c-e4d9-4cff-8c7f-28eddda50525 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:04.126982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-50d21d9c-e4d9-4cff-8c7f-28eddda50525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:04.240202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d21d9c-e4d9-4cff-8c7f-28eddda50525 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:04.260346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:04.315331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29832b-6cf4-4ae4-a510-6dda4c310140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:04.316015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29832b-6cf4-4ae4-a510-6dda4c310140 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:04.316294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29832b-6cf4-4ae4-a510-6dda4c310140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:04.316564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29832b-6cf4-4ae4-a510-6dda4c310140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:04.318205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ab29832b-6cf4-4ae4-a510-6dda4c310140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:04.427203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29832b-6cf4-4ae4-a510-6dda4c310140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:04.428593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29832b-6cf4-4ae4-a510-6dda4c310140 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:04.451608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 667/1331] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:06.940505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829eb0-88c2-4957-a837-d82e7068c267 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:06.941148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829eb0-88c2-4957-a837-d82e7068c267 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:06.941343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829eb0-88c2-4957-a837-d82e7068c267 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:06.942984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 665/1332] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:06.948963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e709ad3-2d35-49a7-8dc5-63c09766c42e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:06.949446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e709ad3-2d35-49a7-8dc5-63c09766c42e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:06.949556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e709ad3-2d35-49a7-8dc5-63c09766c42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:07.020518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:07.024278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2e709ad3-2d35-49a7-8dc5-63c09766c42e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:07.026067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2e709ad3-2d35-49a7-8dc5-63c09766c42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:07.124346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 668/1333] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:07.160179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829eb0-88c2-4957-a837-d82e7068c267 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:07.161717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-67829eb0-88c2-4957-a837-d82e7068c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:07.269469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829eb0-88c2-4957-a837-d82e7068c267 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:07.345538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6655-9329-47b9-8017-a054c2c66fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:07.346190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6655-9329-47b9-8017-a054c2c66fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:07.346474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6655-9329-47b9-8017-a054c2c66fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:07.346756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6655-9329-47b9-8017-a054c2c66fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:07.348448 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6a6e6655-9329-47b9-8017-a054c2c66fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:07.375217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:07.457616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e6655-9329-47b9-8017-a054c2c66fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:07.459093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e6655-9329-47b9-8017-a054c2c66fd7 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:07.477473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 666/1334] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:09.826403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207fa5-a24f-47c6-88e7-e76fbc38c853 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:09.826914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207fa5-a24f-47c6-88e7-e76fbc38c853 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:09.827035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc207fa5-a24f-47c6-88e7-e76fbc38c853 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:09.828894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 669/1335] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:09.834209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f83ff-5f62-4643-9b90-1175fd3e102d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:09.834650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f83ff-5f62-4643-9b90-1175fd3e102d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:09.834758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f83ff-5f62-4643-9b90-1175fd3e102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:09.899677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-861f83ff-5f62-4643-9b90-1175fd3e102d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:09.900814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-861f83ff-5f62-4643-9b90-1175fd3e102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:09.973024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:09.995416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 667/1336] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:10.036759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc207fa5-a24f-47c6-88e7-e76fbc38c853 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:10.038333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-cc207fa5-a24f-47c6-88e7-e76fbc38c853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:10.143821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc207fa5-a24f-47c6-88e7-e76fbc38c853 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:10.171871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:10.217552 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109aeb9-67e6-4a20-93fb-a03ca78f0048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:10.218237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109aeb9-67e6-4a20-93fb-a03ca78f0048 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:10.218521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109aeb9-67e6-4a20-93fb-a03ca78f0048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:10.218799 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109aeb9-67e6-4a20-93fb-a03ca78f0048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:10.220505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b109aeb9-67e6-4a20-93fb-a03ca78f0048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:10.329968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109aeb9-67e6-4a20-93fb-a03ca78f0048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:10.331430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109aeb9-67e6-4a20-93fb-a03ca78f0048 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:10.349280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 670/1337] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:13.034850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0473d6-f70c-4a36-b2ea-2a3c426accfd None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:13.035388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0473d6-f70c-4a36-b2ea-2a3c426accfd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:13.035388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0473d6-f70c-4a36-b2ea-2a3c426accfd None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:13.036744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 668/1338] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:13.041947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a856c-f578-41f6-a7c0-ff0a0dfa76a8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:13.042372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a856c-f578-41f6-a7c0-ff0a0dfa76a8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:13.042513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a856c-f578-41f6-a7c0-ff0a0dfa76a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:13.106823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fd5a856c-f578-41f6-a7c0-ff0a0dfa76a8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:13.108068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fd5a856c-f578-41f6-a7c0-ff0a0dfa76a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:13.116872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:13.208323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 671/1339] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:13.245370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0473d6-f70c-4a36-b2ea-2a3c426accfd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:13.246894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3f0473d6-f70c-4a36-b2ea-2a3c426accfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:13.350014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0473d6-f70c-4a36-b2ea-2a3c426accfd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:13.421617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b51e6f-17ec-40c7-b0d7-fcede7ddd7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:13.422257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b51e6f-17ec-40c7-b0d7-fcede7ddd7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:13.422542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b51e6f-17ec-40c7-b0d7-fcede7ddd7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:13.422821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b51e6f-17ec-40c7-b0d7-fcede7ddd7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:13.424505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d8b51e6f-17ec-40c7-b0d7-fcede7ddd7b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:13.459168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:13.532471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b51e6f-17ec-40c7-b0d7-fcede7ddd7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:13.533906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b51e6f-17ec-40c7-b0d7-fcede7ddd7b2 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:13.551451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 669/1340] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:17.758285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc07e-9043-4efc-8fff-d217f20a636b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:17.758861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc07e-9043-4efc-8fff-d217f20a636b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:17.758861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc07e-9043-4efc-8fff-d217f20a636b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:17.760248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 672/1341] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:17.766866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd850-6f15-4f99-a0ae-bab923104a5d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:17.767337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd850-6f15-4f99-a0ae-bab923104a5d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:17.767453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd850-6f15-4f99-a0ae-bab923104a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:17.838498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-71cfd850-6f15-4f99-a0ae-bab923104a5d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:17.839609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-71cfd850-6f15-4f99-a0ae-bab923104a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:17.932622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:17.948254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 670/1342] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:17.987504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc07e-9043-4efc-8fff-d217f20a636b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:17.989717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d16fc07e-9043-4efc-8fff-d217f20a636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:18.087103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc07e-9043-4efc-8fff-d217f20a636b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:18.090736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18435fbd-67d4-420e-8990-c3c6ecc5815f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:18.091312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18435fbd-67d4-420e-8990-c3c6ecc5815f service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:18.091614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18435fbd-67d4-420e-8990-c3c6ecc5815f service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:18.091888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18435fbd-67d4-420e-8990-c3c6ecc5815f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:18.101954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18435fbd-67d4-420e-8990-c3c6ecc5815f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:18.103674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18435fbd-67d4-420e-8990-c3c6ecc5815f service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:18.114041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 673/1343] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:19:21.121695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84c17-f5d2-4175-8ee3-df2220057af6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:21.122218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84c17-f5d2-4175-8ee3-df2220057af6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:21.122313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84c17-f5d2-4175-8ee3-df2220057af6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:21.123677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 671/1344] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:21.129587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203d9d4-2e41-4e3f-9bf7-bb69e538fa30 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:21.130034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203d9d4-2e41-4e3f-9bf7-bb69e538fa30 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:21.130131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203d9d4-2e41-4e3f-9bf7-bb69e538fa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:21.160124 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5203d9d4-2e41-4e3f-9bf7-bb69e538fa30 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:21.161338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5203d9d4-2e41-4e3f-9bf7-bb69e538fa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:21.190369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:21.241716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 674/1345] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:21.279463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84c17-f5d2-4175-8ee3-df2220057af6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:21.290121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84c17-f5d2-4175-8ee3-df2220057af6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:21.293867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace247e1-04a0-42ec-a113-34c95d3e00ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:21.294499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace247e1-04a0-42ec-a113-34c95d3e00ea service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:21.294782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace247e1-04a0-42ec-a113-34c95d3e00ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:21.295065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace247e1-04a0-42ec-a113-34c95d3e00ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:21.304202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace247e1-04a0-42ec-a113-34c95d3e00ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:21.305626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace247e1-04a0-42ec-a113-34c95d3e00ea service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:21.315763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 672/1346] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:25.790310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bed62-1ccb-4e52-87ec-ec1d9fd0ecb2 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:25.790875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bed62-1ccb-4e52-87ec-ec1d9fd0ecb2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:25.790875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bed62-1ccb-4e52-87ec-ec1d9fd0ecb2 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:25.792443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 675/1347] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:25.797929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba708ecc-bea5-4f64-9370-026dffd418af None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:25.798416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba708ecc-bea5-4f64-9370-026dffd418af None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:25.798516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba708ecc-bea5-4f64-9370-026dffd418af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:25.818141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ba708ecc-bea5-4f64-9370-026dffd418af None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:25.819799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ba708ecc-bea5-4f64-9370-026dffd418af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:25.829017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 673/1348] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:25.866606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bed62-1ccb-4e52-87ec-ec1d9fd0ecb2 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:25.877975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bed62-1ccb-4e52-87ec-ec1d9fd0ecb2 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:25.881531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba684f-9650-4591-862b-9cdabdd75abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:25.882159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba684f-9650-4591-862b-9cdabdd75abf service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:25.882470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba684f-9650-4591-862b-9cdabdd75abf service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:25.882748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba684f-9650-4591-862b-9cdabdd75abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:25.892360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba684f-9650-4591-862b-9cdabdd75abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:25.893793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba684f-9650-4591-862b-9cdabdd75abf service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:25.903268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 676/1349] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:31.292555 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c20b1-802c-4600-9cf6-8da92d98ac39 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:31.293092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c20b1-802c-4600-9cf6-8da92d98ac39 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:31.293351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c20b1-802c-4600-9cf6-8da92d98ac39 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:31.295082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 674/1350] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:19:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:31.299924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe40441-2a01-47f9-bb79-ef5ec1695b9f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:31.300348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe40441-2a01-47f9-bb79-ef5ec1695b9f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:31.300602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe40441-2a01-47f9-bb79-ef5ec1695b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:31.411817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-dbe40441-2a01-47f9-bb79-ef5ec1695b9f None None] MFA Rules not processed for user `88e5d3ba49164f55a063aa60643bd421`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:31.413087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dbe40441-2a01-47f9-bb79-ef5ec1695b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:31.489424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 677/1351] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:19:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:35.811659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=13 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:36.110379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2fe27-27fe-495c-9011-67b8aaeaf7c5 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:36.110737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2fe27-27fe-495c-9011-67b8aaeaf7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:36.110944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2fe27-27fe-495c-9011-67b8aaeaf7c5 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:36.112561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 675/1352] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:19:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:36.117506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be085-957c-40c6-934b-11c377d3459b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:36.118408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be085-957c-40c6-934b-11c377d3459b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:36.118968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455be085-957c-40c6-934b-11c377d3459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:36.140796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-455be085-957c-40c6-934b-11c377d3459b None None] MFA Rules not processed for user `88e5d3ba49164f55a063aa60643bd421`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:36.142418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-455be085-957c-40c6-934b-11c377d3459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:36.152281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 678/1353] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:19:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:37.693453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560000-2e83-4631-8e52-3c40a24f9628 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:37.694016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560000-2e83-4631-8e52-3c40a24f9628 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:37.694180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560000-2e83-4631-8e52-3c40a24f9628 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:37.695674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 676/1354] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:19:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:37.700946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aae33-ff02-4c18-b2f8-1570ca9798e8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:37.701425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aae33-ff02-4c18-b2f8-1570ca9798e8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:37.701524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aae33-ff02-4c18-b2f8-1570ca9798e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:37.721440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-087aae33-ff02-4c18-b2f8-1570ca9798e8 None None] MFA Rules not processed for user `88e5d3ba49164f55a063aa60643bd421`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:37.722818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-087aae33-ff02-4c18-b2f8-1570ca9798e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:37.734333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 679/1355] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:19:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:41.564538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf6c28-a7e0-45e2-84cd-d9d64e46b6b8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:41.565135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf6c28-a7e0-45e2-84cd-d9d64e46b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:41.565135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf6c28-a7e0-45e2-84cd-d9d64e46b6b8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:41.566440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 677/1356] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:41.571937 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dc16c-7111-44fb-930e-efe5ff839d81 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:41.572416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dc16c-7111-44fb-930e-efe5ff839d81 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:41.572545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dc16c-7111-44fb-930e-efe5ff839d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:41.592128 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b22dc16c-7111-44fb-930e-efe5ff839d81 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:41.593335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b22dc16c-7111-44fb-930e-efe5ff839d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:41.601545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 680/1357] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:41.658616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebf65d-6937-4139-a33e-138f3d52c214 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:41.659093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebf65d-6937-4139-a33e-138f3d52c214 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:41.659522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebf65d-6937-4139-a33e-138f3d52c214 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:41.661195 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 678/1358] 10.222.0.112 () {54 vars in 966 bytes} [Fri Jun 3 16:19:41 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:41.680792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872ce8-1bf4-4a15-a7c5-eb2b235352cc None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:41.688051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872ce8-1bf4-4a15-a7c5-eb2b235352cc None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:41.688346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be872ce8-1bf4-4a15-a7c5-eb2b235352cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:41.743901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:41.753089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-be872ce8-1bf4-4a15-a7c5-eb2b235352cc None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:41.754285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-be872ce8-1bf4-4a15-a7c5-eb2b235352cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:41.840805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 681/1359] 10.222.0.112 () {58 vars in 1063 bytes} [Fri Jun 3 16:19:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:19:41.848725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebf65d-6937-4139-a33e-138f3d52c214 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:41.864221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebf65d-6937-4139-a33e-138f3d52c214 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:41.870283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b0d4a-327c-40e4-aab4-2b830ff15ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:41.870914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0d4a-327c-40e4-aab4-2b830ff15ef4 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:41.871199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0d4a-327c-40e4-aab4-2b830ff15ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:41.871477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0d4a-327c-40e4-aab4-2b830ff15ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:41.880773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b0d4a-327c-40e4-aab4-2b830ff15ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:41.882366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b0d4a-327c-40e4-aab4-2b830ff15ef4 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:41.892845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 679/1360] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:19:44.371538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da42eb-b72b-4b5e-a7b1-8a8bd290892a None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:44.372130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da42eb-b72b-4b5e-a7b1-8a8bd290892a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:44.372130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da42eb-b72b-4b5e-a7b1-8a8bd290892a None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:44.373474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 682/1361] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:44.379455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dc7aa-8f60-4586-9b18-754021b221d9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:44.379919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dc7aa-8f60-4586-9b18-754021b221d9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:44.380240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dc7aa-8f60-4586-9b18-754021b221d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:44.398521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f17dc7aa-8f60-4586-9b18-754021b221d9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:44.399889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f17dc7aa-8f60-4586-9b18-754021b221d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:44.408591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 680/1362] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:44.452037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da42eb-b72b-4b5e-a7b1-8a8bd290892a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:44.467438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da42eb-b72b-4b5e-a7b1-8a8bd290892a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:44.477317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecc2d1-5602-4b92-a0e2-beed4c659385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:44.478085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc2d1-5602-4b92-a0e2-beed4c659385 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:44.478467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc2d1-5602-4b92-a0e2-beed4c659385 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:44.479125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc2d1-5602-4b92-a0e2-beed4c659385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:44.489363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecc2d1-5602-4b92-a0e2-beed4c659385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:44.491320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecc2d1-5602-4b92-a0e2-beed4c659385 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:44.502152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 683/1363] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:47.139690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651968-3f6b-4b27-a5e6-ed336edf844b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:47.140856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651968-3f6b-4b27-a5e6-ed336edf844b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:47.140856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651968-3f6b-4b27-a5e6-ed336edf844b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:47.142176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 681/1364] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:47.148147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb6464-a228-4b19-a5c0-3a123d6f73b8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:47.148935 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb6464-a228-4b19-a5c0-3a123d6f73b8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:47.148935 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb6464-a228-4b19-a5c0-3a123d6f73b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:47.168984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d3fb6464-a228-4b19-a5c0-3a123d6f73b8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:47.170215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d3fb6464-a228-4b19-a5c0-3a123d6f73b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:47.178568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 684/1365] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:19:47.226721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922071-3a71-44ac-8e4b-d0411c7e0086 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:47.227058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922071-3a71-44ac-8e4b-d0411c7e0086 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:47.227373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922071-3a71-44ac-8e4b-d0411c7e0086 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:47.228818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 682/1366] 10.222.0.112 () {54 vars in 966 bytes} [Fri Jun 3 16:19:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:19:47.235372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592e03-fb58-4019-9033-cb88f112a42b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:47.235794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592e03-fb58-4019-9033-cb88f112a42b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:47.236146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592e03-fb58-4019-9033-cb88f112a42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:47.261428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-63592e03-fb58-4019-9033-cb88f112a42b None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:47.262647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-63592e03-fb58-4019-9033-cb88f112a42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:47.273271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 685/1367] 10.222.0.112 () {58 vars in 1063 bytes} [Fri Jun 3 16:19:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:19:47.283310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59922071-3a71-44ac-8e4b-d0411c7e0086 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:47.312136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59922071-3a71-44ac-8e4b-d0411c7e0086 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:47.317982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196d3de-216e-404d-9462-fd2e7c89e80f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:47.318799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d3de-216e-404d-9462-fd2e7c89e80f service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:47.319106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d3de-216e-404d-9462-fd2e7c89e80f service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:47.319388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196d3de-216e-404d-9462-fd2e7c89e80f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:47.328904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196d3de-216e-404d-9462-fd2e7c89e80f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:47.330563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196d3de-216e-404d-9462-fd2e7c89e80f service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:47.340517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 683/1368] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:49.699161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af2b15-ffd3-4cfb-9b04-d69122456e66 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:49.700072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af2b15-ffd3-4cfb-9b04-d69122456e66 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:49.700542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af2b15-ffd3-4cfb-9b04-d69122456e66 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:49.702108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 686/1369] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:49.707829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4559b9-3798-4cc2-b545-cc1c5ea4cf15 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:49.708346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4559b9-3798-4cc2-b545-cc1c5ea4cf15 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:49.708431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4559b9-3798-4cc2-b545-cc1c5ea4cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:49.727786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-be4559b9-3798-4cc2-b545-cc1c5ea4cf15 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:49.729277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-be4559b9-3798-4cc2-b545-cc1c5ea4cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:49.738026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 684/1370] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:49.786327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af2b15-ffd3-4cfb-9b04-d69122456e66 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:49.803628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af2b15-ffd3-4cfb-9b04-d69122456e66 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:49.810069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bf858-f60e-4aae-b194-5c314c8d1395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:49.810814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf858-f60e-4aae-b194-5c314c8d1395 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:49.811096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf858-f60e-4aae-b194-5c314c8d1395 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:49.811374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf858-f60e-4aae-b194-5c314c8d1395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:49.821426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bf858-f60e-4aae-b194-5c314c8d1395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:49.823060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bf858-f60e-4aae-b194-5c314c8d1395 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:49.834362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 687/1371] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:50.133650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa9978-6813-4357-955a-6d8cbb2bd922 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:50.134288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa9978-6813-4357-955a-6d8cbb2bd922 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:50.134595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa9978-6813-4357-955a-6d8cbb2bd922 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:50.136305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 685/1372] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:50.142786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add19ef3-53f2-427a-8f9d-28aa53b26fcb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:50.143334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add19ef3-53f2-427a-8f9d-28aa53b26fcb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:50.143851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add19ef3-53f2-427a-8f9d-28aa53b26fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:50.168371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-add19ef3-53f2-427a-8f9d-28aa53b26fcb None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:50.169598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-add19ef3-53f2-427a-8f9d-28aa53b26fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:50.183043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 688/1373] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:50.495788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4053a6-dec7-445a-976e-4d77cc18d850 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:50.495788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4053a6-dec7-445a-976e-4d77cc18d850 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:50.495788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4053a6-dec7-445a-976e-4d77cc18d850 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:50.498593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 686/1374] 10.222.0.112 () {54 vars in 968 bytes} [Fri Jun 3 16:19:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:50.502383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2a290-5803-4a7e-9db8-5b2230ca5e88 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:50.502743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2a290-5803-4a7e-9db8-5b2230ca5e88 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:50.503082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2a290-5803-4a7e-9db8-5b2230ca5e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:50.588313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f5e2a290-5803-4a7e-9db8-5b2230ca5e88 None None] MFA Rules not processed for user `8571493023904002bd334e74441d134d`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:50.589633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f5e2a290-5803-4a7e-9db8-5b2230ca5e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:50.674554 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 689/1375] 10.222.0.112 () {58 vars in 1065 bytes} [Fri Jun 3 16:19:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:50.679910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4053a6-dec7-445a-976e-4d77cc18d850 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:50.692344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4053a6-dec7-445a-976e-4d77cc18d850 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:50.696686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad597c-ba1b-4b42-a791-fc97fd2b4065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:50.697351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad597c-ba1b-4b42-a791-fc97fd2b4065 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:50.697635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad597c-ba1b-4b42-a791-fc97fd2b4065 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:50.697909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad597c-ba1b-4b42-a791-fc97fd2b4065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:50.711303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad597c-ba1b-4b42-a791-fc97fd2b4065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:50.715179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad597c-ba1b-4b42-a791-fc97fd2b4065 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:50.740691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 687/1376] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:52.368403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee85ab-f9e2-410c-acaa-006348d6c68c None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:52.369009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee85ab-f9e2-410c-acaa-006348d6c68c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:52.369009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee85ab-f9e2-410c-acaa-006348d6c68c None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:52.370217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 690/1377] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:52.377245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131ed5-4e4d-4708-a65d-3356d05d4d6e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:52.377801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131ed5-4e4d-4708-a65d-3356d05d4d6e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:52.378065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131ed5-4e4d-4708-a65d-3356d05d4d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:52.401019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2b131ed5-4e4d-4708-a65d-3356d05d4d6e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:52.402228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2b131ed5-4e4d-4708-a65d-3356d05d4d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:52.414458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 688/1378] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:52.459317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee85ab-f9e2-410c-acaa-006348d6c68c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:52.476543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee85ab-f9e2-410c-acaa-006348d6c68c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:52.483515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99614-5300-45f4-8882-5efaf6c6f781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:52.484256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99614-5300-45f4-8882-5efaf6c6f781 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:52.484535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99614-5300-45f4-8882-5efaf6c6f781 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:52.484816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99614-5300-45f4-8882-5efaf6c6f781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:52.494606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d99614-5300-45f4-8882-5efaf6c6f781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:52.496253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d99614-5300-45f4-8882-5efaf6c6f781 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:52.500446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:52.508822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 691/1379] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:54.890712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388cc2d-5e7f-4931-8ceb-5e3bd47a60e9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:54.891693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388cc2d-5e7f-4931-8ceb-5e3bd47a60e9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:54.891987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388cc2d-5e7f-4931-8ceb-5e3bd47a60e9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:54.893517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 689/1380] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:19:54.899055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cf963-a3a8-484c-9bdf-57a386f5766f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:54.899482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cf963-a3a8-484c-9bdf-57a386f5766f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:54.899633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cf963-a3a8-484c-9bdf-57a386f5766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:54.917792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7a0cf963-a3a8-484c-9bdf-57a386f5766f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:54.919234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7a0cf963-a3a8-484c-9bdf-57a386f5766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:54.927380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 692/1381] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:54.975792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388cc2d-5e7f-4931-8ceb-5e3bd47a60e9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:54.993172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388cc2d-5e7f-4931-8ceb-5e3bd47a60e9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:54.999970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce2a98-387a-4d42-8052-250478634dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:55.000880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce2a98-387a-4d42-8052-250478634dd3 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:55.001371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce2a98-387a-4d42-8052-250478634dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:55.001835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce2a98-387a-4d42-8052-250478634dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:55.012205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce2a98-387a-4d42-8052-250478634dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:55.014153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce2a98-387a-4d42-8052-250478634dd3 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:55.025745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 690/1382] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:19:57.415627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e9ab-811e-411d-b75f-37fa238f5bdd None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:57.416255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e9ab-811e-411d-b75f-37fa238f5bdd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:57.416255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e9ab-811e-411d-b75f-37fa238f5bdd None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:57.417986 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 693/1383] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:19:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:19:57.424196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687a519-79ef-459b-980c-12645febf930 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:57.425395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687a519-79ef-459b-980c-12645febf930 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:57.425395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687a519-79ef-459b-980c-12645febf930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:57.444943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f687a519-79ef-459b-980c-12645febf930 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:19:57.446177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f687a519-79ef-459b-980c-12645febf930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:19:57.457089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 691/1384] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:19:57.503303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e9ab-811e-411d-b75f-37fa238f5bdd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:19:57.520147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e9ab-811e-411d-b75f-37fa238f5bdd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:19:57.526015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888897b-71e6-49e5-a2f4-1224073d7831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:19:57.526671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888897b-71e6-49e5-a2f4-1224073d7831 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:19:57.526949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888897b-71e6-49e5-a2f4-1224073d7831 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:19:57.527228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888897b-71e6-49e5-a2f4-1224073d7831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:19:57.537598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888897b-71e6-49e5-a2f4-1224073d7831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:19:57.539182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888897b-71e6-49e5-a2f4-1224073d7831 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:19:57.550516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 694/1385] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:20:00.351966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963123d-fab5-4225-84ab-d4f9e5deb9fc None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:00.353115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963123d-fab5-4225-84ab-d4f9e5deb9fc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:00.353115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963123d-fab5-4225-84ab-d4f9e5deb9fc None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:00.355262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 692/1386] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:20:00 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:00.362803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ab705-b50c-46c7-bdab-47e1679343bc None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:00.363581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ab705-b50c-46c7-bdab-47e1679343bc None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:00.363581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ab705-b50c-46c7-bdab-47e1679343bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:00.388186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-411ab705-b50c-46c7-bdab-47e1679343bc None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:00.390070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-411ab705-b50c-46c7-bdab-47e1679343bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:00.402031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 695/1387] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:00.469784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963123d-fab5-4225-84ab-d4f9e5deb9fc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:00.489278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963123d-fab5-4225-84ab-d4f9e5deb9fc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:00.495442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1715418-66ee-4a05-b7b4-7edf2e1b8254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:00.496330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715418-66ee-4a05-b7b4-7edf2e1b8254 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:00.496626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715418-66ee-4a05-b7b4-7edf2e1b8254 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:00.496915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1715418-66ee-4a05-b7b4-7edf2e1b8254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:00.508532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1715418-66ee-4a05-b7b4-7edf2e1b8254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:00.511138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1715418-66ee-4a05-b7b4-7edf2e1b8254 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:00.530119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 693/1388] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:03.199136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878fc4-fb80-4b44-b759-fb0bddd27835 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:03.200929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878fc4-fb80-4b44-b759-fb0bddd27835 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:03.201693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878fc4-fb80-4b44-b759-fb0bddd27835 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:03.205633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 696/1389] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:20:03 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:20:03.212436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062107b6-ab69-4af4-b894-e542f5710584 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:03.213351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062107b6-ab69-4af4-b894-e542f5710584 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:03.213351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062107b6-ab69-4af4-b894-e542f5710584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:03.235169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-062107b6-ab69-4af4-b894-e542f5710584 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:03.236509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-062107b6-ab69-4af4-b894-e542f5710584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:03.245143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 694/1390] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:20:03.292517 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878fc4-fb80-4b44-b759-fb0bddd27835 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:03.313831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878fc4-fb80-4b44-b759-fb0bddd27835 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:03.319998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0940c6-5dd9-441e-95a5-1e0a960a5102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:03.320670 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0940c6-5dd9-441e-95a5-1e0a960a5102 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:03.320953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0940c6-5dd9-441e-95a5-1e0a960a5102 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:03.321223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0940c6-5dd9-441e-95a5-1e0a960a5102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:03.331612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0940c6-5dd9-441e-95a5-1e0a960a5102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:03.333261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0940c6-5dd9-441e-95a5-1e0a960a5102 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:03.345185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 697/1391] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:20:05.941481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c494d-14c3-4a94-b158-57480917e3f9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:05.942034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c494d-14c3-4a94-b158-57480917e3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:05.942034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c494d-14c3-4a94-b158-57480917e3f9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:05.943373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 695/1392] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:20:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:05.949190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f954-c789-4f36-9bbb-e8299a2799db None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:05.949683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f954-c789-4f36-9bbb-e8299a2799db None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:05.949817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f954-c789-4f36-9bbb-e8299a2799db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:05.967868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3099f954-c789-4f36-9bbb-e8299a2799db None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:05.969657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3099f954-c789-4f36-9bbb-e8299a2799db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:05.977398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 698/1393] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:20:06.021984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c494d-14c3-4a94-b158-57480917e3f9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:06.030269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=46 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:06.038284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c494d-14c3-4a94-b158-57480917e3f9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:06.043950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868b17d-2429-4f0a-95e2-5650e87c70c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:06.044608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868b17d-2429-4f0a-95e2-5650e87c70c6 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:06.044937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868b17d-2429-4f0a-95e2-5650e87c70c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:06.045280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868b17d-2429-4f0a-95e2-5650e87c70c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:06.054584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868b17d-2429-4f0a-95e2-5650e87c70c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:06.056223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868b17d-2429-4f0a-95e2-5650e87c70c6 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:06.067021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 696/1394] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:07.146486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbfbb-f24c-4952-b3b4-bd687aa76471 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:07.147037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbfbb-f24c-4952-b3b4-bd687aa76471 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:07.147037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbfbb-f24c-4952-b3b4-bd687aa76471 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:07.148509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 699/1395] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:20:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:07.153975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012f078-075a-4ec2-b67c-63ae6614b80f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:07.154423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012f078-075a-4ec2-b67c-63ae6614b80f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:07.154669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012f078-075a-4ec2-b67c-63ae6614b80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:07.174816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b012f078-075a-4ec2-b67c-63ae6614b80f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:07.176212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b012f078-075a-4ec2-b67c-63ae6614b80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:07.184859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 697/1396] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:07.251248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c10bf-7a4d-4ee4-b64b-b1da806590ab None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:07.251568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c10bf-7a4d-4ee4-b64b-b1da806590ab None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:07.251884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c10bf-7a4d-4ee4-b64b-b1da806590ab None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:07.253434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 700/1397] 10.222.0.112 () {54 vars in 967 bytes} [Fri Jun 3 16:20:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:07.260503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca1db6-afe5-4fc3-aafc-6864b06796ba None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:07.260798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca1db6-afe5-4fc3-aafc-6864b06796ba None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:07.261104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca1db6-afe5-4fc3-aafc-6864b06796ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:07.310470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-50ca1db6-afe5-4fc3-aafc-6864b06796ba None None] MFA Rules not processed for user `5f440bbc0414415186ae83d9fa3842bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:07.311723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-50ca1db6-afe5-4fc3-aafc-6864b06796ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:07.375788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 698/1398] 10.222.0.112 () {58 vars in 1064 bytes} [Fri Jun 3 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:07.383366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c10bf-7a4d-4ee4-b64b-b1da806590ab None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:07.397299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c10bf-7a4d-4ee4-b64b-b1da806590ab None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:07.400932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95720a4d-d4f8-4b08-8c46-79fc7f864304 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f440bbc0414415186ae83d9fa3842bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:07.401675 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95720a4d-d4f8-4b08-8c46-79fc7f864304 service glance] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:07.402185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95720a4d-d4f8-4b08-8c46-79fc7f864304 service glance] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:07.402329 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95720a4d-d4f8-4b08-8c46-79fc7f864304 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:07.412945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95720a4d-d4f8-4b08-8c46-79fc7f864304 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:07.414387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95720a4d-d4f8-4b08-8c46-79fc7f864304 service glance] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:07.424917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 701/1399] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:07.965328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9835f-1841-4233-a5ae-0249af5ee2e2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:07.965618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9835f-1841-4233-a5ae-0249af5ee2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:07.965895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9835f-1841-4233-a5ae-0249af5ee2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:08.016816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-52f9835f-1841-4233-a5ae-0249af5ee2e2 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:08.018033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-52f9835f-1841-4233-a5ae-0249af5ee2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:08.088096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 699/1400] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:08.134323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65822ab-cf31-416c-bf7c-7624ff630751 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:08.134620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65822ab-cf31-416c-bf7c-7624ff630751 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:08.134906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65822ab-cf31-416c-bf7c-7624ff630751 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:08.136340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 702/1401] 10.222.0.112 () {54 vars in 947 bytes} [Fri Jun 3 16:20:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:08.142613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf075a-a6e8-4ca2-8588-33c5ba23defa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:08.143543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf075a-a6e8-4ca2-8588-33c5ba23defa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:08.143866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf075a-a6e8-4ca2-8588-33c5ba23defa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:08.195238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:08.198626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fcaf075a-a6e8-4ca2-8588-33c5ba23defa None None] MFA Rules not processed for user `f8e7179f5fe945f4be1ca16263042b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:08.200462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fcaf075a-a6e8-4ca2-8588-33c5ba23defa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:08.273785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 700/1402] 10.222.0.112 () {58 vars in 1044 bytes} [Fri Jun 3 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:08.283383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65822ab-cf31-416c-bf7c-7624ff630751 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:08.297372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65822ab-cf31-416c-bf7c-7624ff630751 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:08.302624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea813ea-8db2-4ece-a6be-f4fe33a0aae7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:08.303254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea813ea-8db2-4ece-a6be-f4fe33a0aae7 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:08.303537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea813ea-8db2-4ece-a6be-f4fe33a0aae7 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:08.303861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea813ea-8db2-4ece-a6be-f4fe33a0aae7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:08.312831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea813ea-8db2-4ece-a6be-f4fe33a0aae7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:08.314403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea813ea-8db2-4ece-a6be-f4fe33a0aae7 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:08.322576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 703/1403] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:20:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:20:08.366557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962ab0b-5d60-46f5-9808-947ab2158b44 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:08.366843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962ab0b-5d60-46f5-9808-947ab2158b44 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:08.367125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962ab0b-5d60-46f5-9808-947ab2158b44 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:08.368535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 701/1404] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:20:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:08.374160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f29133-e744-4fae-aacb-be45c497b53d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:08.374528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f29133-e744-4fae-aacb-be45c497b53d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:08.374883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f29133-e744-4fae-aacb-be45c497b53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:08.394085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-42f29133-e744-4fae-aacb-be45c497b53d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:08.395961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-42f29133-e744-4fae-aacb-be45c497b53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:08.405061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 704/1405] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:08.452182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962ab0b-5d60-46f5-9808-947ab2158b44 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:08.467480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962ab0b-5d60-46f5-9808-947ab2158b44 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:08.473730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d43f08-c917-4130-8b68-a6c7699416f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:08.474370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d43f08-c917-4130-8b68-a6c7699416f7 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:08.474655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d43f08-c917-4130-8b68-a6c7699416f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:08.474933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d43f08-c917-4130-8b68-a6c7699416f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:08.486718 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d43f08-c917-4130-8b68-a6c7699416f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:08.486718 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d43f08-c917-4130-8b68-a6c7699416f7 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:08.496550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 702/1406] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:10.839767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ea7e-e0cd-4470-a529-f26af81f279e None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:10.840292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ea7e-e0cd-4470-a529-f26af81f279e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:10.840292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ea7e-e0cd-4470-a529-f26af81f279e None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:10.841840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 705/1407] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:20:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:10.847265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b809d8-9681-4b90-89c8-4e6239e68558 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:10.847842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b809d8-9681-4b90-89c8-4e6239e68558 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:10.847842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b809d8-9681-4b90-89c8-4e6239e68558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:10.867162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f2b809d8-9681-4b90-89c8-4e6239e68558 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:10.868545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f2b809d8-9681-4b90-89c8-4e6239e68558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:10.887603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 703/1408] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:10.923068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775ea7e-e0cd-4470-a529-f26af81f279e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:10.943124 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775ea7e-e0cd-4470-a529-f26af81f279e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:10.951002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f60cd-3c28-4ae2-85c3-e05551536242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:10.951702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f60cd-3c28-4ae2-85c3-e05551536242 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:10.952022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f60cd-3c28-4ae2-85c3-e05551536242 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:10.952972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f60cd-3c28-4ae2-85c3-e05551536242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:10.965805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f60cd-3c28-4ae2-85c3-e05551536242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:10.967478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f60cd-3c28-4ae2-85c3-e05551536242 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:10.978898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 706/1409] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:20.861309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=39 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:20.973976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=43 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:31.785047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76d8b-0021-4f1e-a631-9fc462707f02 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:31.785590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76d8b-0021-4f1e-a631-9fc462707f02 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:31.785590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76d8b-0021-4f1e-a631-9fc462707f02 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:31.786961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 704/1410] 10.222.0.112 () {54 vars in 923 bytes} [Fri Jun 3 16:20:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:31.792536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5382cb-ab8b-4572-ad03-b61f1e1bed88 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:31.793165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5382cb-ab8b-4572-ad03-b61f1e1bed88 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:31.793165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5382cb-ab8b-4572-ad03-b61f1e1bed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:31.810953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3e5382cb-ab8b-4572-ad03-b61f1e1bed88 None None] MFA Rules not processed for user `88e5d3ba49164f55a063aa60643bd421`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:31.812182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3e5382cb-ab8b-4572-ad03-b61f1e1bed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:31.820922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 707/1411] 10.222.0.112 () {58 vars in 1020 bytes} [Fri Jun 3 16:20:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:31.835827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1943900-c3eb-49bd-ad58-59880e3972a5 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:31.836119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1943900-c3eb-49bd-ad58-59880e3972a5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:31.836399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1943900-c3eb-49bd-ad58-59880e3972a5 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:31.837796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 705/1412] 10.222.0.112 () {54 vars in 923 bytes} [Fri Jun 3 16:20:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:31.842247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264ff83-8aee-447c-93e0-30ba3df74870 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:31.842539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264ff83-8aee-447c-93e0-30ba3df74870 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:31.842818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264ff83-8aee-447c-93e0-30ba3df74870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:31.861546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b264ff83-8aee-447c-93e0-30ba3df74870 None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:31.862750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b264ff83-8aee-447c-93e0-30ba3df74870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:31.871808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 708/1413] 10.222.0.112 () {58 vars in 1020 bytes} [Fri Jun 3 16:20:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:34.598216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91678c9-ae15-4c91-bc30-3c748421df61 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:34.598780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91678c9-ae15-4c91-bc30-3c748421df61 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:34.598780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91678c9-ae15-4c91-bc30-3c748421df61 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:34.600098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:20:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:34.605625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49315c07-2f4d-4f99-9f6f-29873589a808 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:34.606056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49315c07-2f4d-4f99-9f6f-29873589a808 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:34.606170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49315c07-2f4d-4f99-9f6f-29873589a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:34.624072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-49315c07-2f4d-4f99-9f6f-29873589a808 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:34.625864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-49315c07-2f4d-4f99-9f6f-29873589a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:34.633602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:20:34.675952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91678c9-ae15-4c91-bc30-3c748421df61 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:34.691278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91678c9-ae15-4c91-bc30-3c748421df61 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:34.696704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7381c8-f9ef-44e9-bce6-e491cec480ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:34.697335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7381c8-f9ef-44e9-bce6-e491cec480ff service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:34.697620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7381c8-f9ef-44e9-bce6-e491cec480ff service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:34.697898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7381c8-f9ef-44e9-bce6-e491cec480ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:34.706415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7381c8-f9ef-44e9-bce6-e491cec480ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:34.708025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7381c8-f9ef-44e9-bce6-e491cec480ff service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:34.717331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 707/1416] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:35.714083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16849-5142-4812-9d10-d017f778a5de None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:35.714575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16849-5142-4812-9d10-d017f778a5de None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:35.714700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16849-5142-4812-9d10-d017f778a5de None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:35.716054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:20:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:35.721615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d04a03-ff6b-4bb2-ad0b-0163a5753e8b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:35.722062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d04a03-ff6b-4bb2-ad0b-0163a5753e8b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:35.722167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d04a03-ff6b-4bb2-ad0b-0163a5753e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:35.740674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-66d04a03-ff6b-4bb2-ad0b-0163a5753e8b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:35.741879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-66d04a03-ff6b-4bb2-ad0b-0163a5753e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:35.749682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:35.910020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16849-5142-4812-9d10-d017f778a5de None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:35.925016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16849-5142-4812-9d10-d017f778a5de None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:35.930462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7cbf7-c624-45d3-b1f5-5eee27383511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:35.931087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7cbf7-c624-45d3-b1f5-5eee27383511 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:35.931377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7cbf7-c624-45d3-b1f5-5eee27383511 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:35.931691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7cbf7-c624-45d3-b1f5-5eee27383511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:35.940186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7cbf7-c624-45d3-b1f5-5eee27383511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:35.941817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7cbf7-c624-45d3-b1f5-5eee27383511 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:35.951248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 711/1419] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:36.885112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683d5fd-c824-440a-be87-713b225a074c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:36.885662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683d5fd-c824-440a-be87-713b225a074c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:36.885662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683d5fd-c824-440a-be87-713b225a074c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:36.887072 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:20:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:36.892489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c50da-df17-4725-9e18-fda4275acfe7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:36.892914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c50da-df17-4725-9e18-fda4275acfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:36.893051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c50da-df17-4725-9e18-fda4275acfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:36.911416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2e4c50da-df17-4725-9e18-fda4275acfe7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:36.912652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2e4c50da-df17-4725-9e18-fda4275acfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:36.920741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:37.069714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683d5fd-c824-440a-be87-713b225a074c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:37.085055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683d5fd-c824-440a-be87-713b225a074c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:37.090523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b4d4-319b-4872-8526-23f1ead89a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:37.091156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b4d4-319b-4872-8526-23f1ead89a94 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:37.091439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b4d4-319b-4872-8526-23f1ead89a94 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:37.091768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b4d4-319b-4872-8526-23f1ead89a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:37.100622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3b4d4-319b-4872-8526-23f1ead89a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:37.102200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3b4d4-319b-4872-8526-23f1ead89a94 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:37.112958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 710/1422] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:38.030521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc0c42-2592-45a4-b8f3-1a5de2ca72eb None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:38.031053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc0c42-2592-45a4-b8f3-1a5de2ca72eb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:38.031053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc0c42-2592-45a4-b8f3-1a5de2ca72eb None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:38.032895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:20:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:38.037988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c261c-fb53-4dcd-870a-5fdc4117a759 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:38.038433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c261c-fb53-4dcd-870a-5fdc4117a759 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:38.038540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c261c-fb53-4dcd-870a-5fdc4117a759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:38.056839 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ff7c261c-fb53-4dcd-870a-5fdc4117a759 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:38.058034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ff7c261c-fb53-4dcd-870a-5fdc4117a759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:38.065764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:38.213860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc0c42-2592-45a4-b8f3-1a5de2ca72eb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:38.232470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc0c42-2592-45a4-b8f3-1a5de2ca72eb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:38.238513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133dee6-2163-4750-aac8-d807904ea1b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:38.239149 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133dee6-2163-4750-aac8-d807904ea1b3 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:38.239433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133dee6-2163-4750-aac8-d807904ea1b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:38.239751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133dee6-2163-4750-aac8-d807904ea1b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:38.248181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133dee6-2163-4750-aac8-d807904ea1b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:38.249773 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133dee6-2163-4750-aac8-d807904ea1b3 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:38.259203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 714/1425] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:39.169396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadacba-724f-4127-8fa4-49ac735ff848 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:39.169955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadacba-724f-4127-8fa4-49ac735ff848 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:39.169955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadacba-724f-4127-8fa4-49ac735ff848 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:39.171324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:20:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:39.177052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65227af-645f-4967-9ada-d85458782a52 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:39.177435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65227af-645f-4967-9ada-d85458782a52 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:39.177634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65227af-645f-4967-9ada-d85458782a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:39.196636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a65227af-645f-4967-9ada-d85458782a52 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:39.197838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a65227af-645f-4967-9ada-d85458782a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:39.205587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:39.354060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadacba-724f-4127-8fa4-49ac735ff848 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:39.369420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadacba-724f-4127-8fa4-49ac735ff848 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:39.374721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845bc8c-cb56-4e91-8f2d-601123410b6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:39.375985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845bc8c-cb56-4e91-8f2d-601123410b6e service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:39.376266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845bc8c-cb56-4e91-8f2d-601123410b6e service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:39.376541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845bc8c-cb56-4e91-8f2d-601123410b6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:39.384641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845bc8c-cb56-4e91-8f2d-601123410b6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:39.386211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845bc8c-cb56-4e91-8f2d-601123410b6e service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:39.395421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 713/1428] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:40.247017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449860-aebd-4b3a-96dc-72d021d78ebb None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:40.247583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449860-aebd-4b3a-96dc-72d021d78ebb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:40.247583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449860-aebd-4b3a-96dc-72d021d78ebb None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:40.248964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:20:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:40.254468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43add0cf-556c-4522-a2c1-b0c2513ad1a0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:40.254896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43add0cf-556c-4522-a2c1-b0c2513ad1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:40.255003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43add0cf-556c-4522-a2c1-b0c2513ad1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:40.273324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-43add0cf-556c-4522-a2c1-b0c2513ad1a0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:40.274517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-43add0cf-556c-4522-a2c1-b0c2513ad1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:40.282365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:40.431332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab449860-aebd-4b3a-96dc-72d021d78ebb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:40.446100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab449860-aebd-4b3a-96dc-72d021d78ebb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:40.451480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb784454-73d8-4e32-a264-2966a0a08ebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:40.452134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb784454-73d8-4e32-a264-2966a0a08ebc service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:40.452417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb784454-73d8-4e32-a264-2966a0a08ebc service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:40.452693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb784454-73d8-4e32-a264-2966a0a08ebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:40.461546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb784454-73d8-4e32-a264-2966a0a08ebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:40.463140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb784454-73d8-4e32-a264-2966a0a08ebc service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:40.473275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 717/1431] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:41.336084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114d44f-0866-412f-a3e6-6c89fba64478 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:41.336662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114d44f-0866-412f-a3e6-6c89fba64478 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:41.336662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114d44f-0866-412f-a3e6-6c89fba64478 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:41.338029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:20:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:41.343044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5bd8-20ab-4f40-8d39-c9a1b3d0c059 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:41.343471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5bd8-20ab-4f40-8d39-c9a1b3d0c059 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:41.343621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5bd8-20ab-4f40-8d39-c9a1b3d0c059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:41.362956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-acae5bd8-20ab-4f40-8d39-c9a1b3d0c059 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:41.364182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-acae5bd8-20ab-4f40-8d39-c9a1b3d0c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:41.372021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:41.518264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114d44f-0866-412f-a3e6-6c89fba64478 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:41.533289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114d44f-0866-412f-a3e6-6c89fba64478 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:41.538917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf1ad2-2f90-46ac-9f1a-f9659bb35868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:41.539571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf1ad2-2f90-46ac-9f1a-f9659bb35868 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:41.539872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf1ad2-2f90-46ac-9f1a-f9659bb35868 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:41.540142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf1ad2-2f90-46ac-9f1a-f9659bb35868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:41.549415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf1ad2-2f90-46ac-9f1a-f9659bb35868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:41.551021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf1ad2-2f90-46ac-9f1a-f9659bb35868 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:41.561096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 716/1434] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:42.407757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a21e64-0293-4a88-a6a9-586e3f1d2400 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:42.408282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a21e64-0293-4a88-a6a9-586e3f1d2400 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:42.408282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a21e64-0293-4a88-a6a9-586e3f1d2400 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:42.409626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:20:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:42.414696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfccd74-f635-4557-bc36-3848a82bfeb3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:42.415109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfccd74-f635-4557-bc36-3848a82bfeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:42.415253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfccd74-f635-4557-bc36-3848a82bfeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:42.432874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7dfccd74-f635-4557-bc36-3848a82bfeb3 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:42.434071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7dfccd74-f635-4557-bc36-3848a82bfeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:42.441880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:42.593417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a21e64-0293-4a88-a6a9-586e3f1d2400 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:42.608018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a21e64-0293-4a88-a6a9-586e3f1d2400 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:42.613391 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308126c-5ed3-4f63-9236-26d47005c9b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:42.614022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308126c-5ed3-4f63-9236-26d47005c9b4 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:42.614314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308126c-5ed3-4f63-9236-26d47005c9b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:42.614593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308126c-5ed3-4f63-9236-26d47005c9b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:42.622598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308126c-5ed3-4f63-9236-26d47005c9b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:42.624218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308126c-5ed3-4f63-9236-26d47005c9b4 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:42.634043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 720/1437] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:43.486552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b92dc-feac-4c02-a5f9-4ee5905c96f1 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:43.487139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b92dc-feac-4c02-a5f9-4ee5905c96f1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:43.487139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b92dc-feac-4c02-a5f9-4ee5905c96f1 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:43.488595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:20:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:43.493717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df9ee0-c096-490f-9d10-b1d957359922 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:43.494152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df9ee0-c096-490f-9d10-b1d957359922 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:43.494281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df9ee0-c096-490f-9d10-b1d957359922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:43.512887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d4df9ee0-c096-490f-9d10-b1d957359922 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:43.514076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d4df9ee0-c096-490f-9d10-b1d957359922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:43.522673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:43.673051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b92dc-feac-4c02-a5f9-4ee5905c96f1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:43.694199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b92dc-feac-4c02-a5f9-4ee5905c96f1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:43.702513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de740226-316c-4cdf-9eab-3a4e60a7f525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:43.703187 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de740226-316c-4cdf-9eab-3a4e60a7f525 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:43.703474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de740226-316c-4cdf-9eab-3a4e60a7f525 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:43.703785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de740226-316c-4cdf-9eab-3a4e60a7f525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:43.712557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de740226-316c-4cdf-9eab-3a4e60a7f525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:43.714137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de740226-316c-4cdf-9eab-3a4e60a7f525 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:43.723467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 719/1440] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:45.833607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bc727-d24a-4fe3-bf14-077d5e4ef3a9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:45.834143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bc727-d24a-4fe3-bf14-077d5e4ef3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:45.834143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bc727-d24a-4fe3-bf14-077d5e4ef3a9 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:45.835512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:20:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:45.841040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda47e7-f25c-45c4-a56f-2182d0f6a4fe None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:45.841495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda47e7-f25c-45c4-a56f-2182d0f6a4fe None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:45.841597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda47e7-f25c-45c4-a56f-2182d0f6a4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:45.860599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3cda47e7-f25c-45c4-a56f-2182d0f6a4fe None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:45.861802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3cda47e7-f25c-45c4-a56f-2182d0f6a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:45.869752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:45.908511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bc727-d24a-4fe3-bf14-077d5e4ef3a9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:45.919282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bc727-d24a-4fe3-bf14-077d5e4ef3a9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:45.922816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a58bd6-0741-4d01-990f-d8cf207d02e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:45.923503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a58bd6-0741-4d01-990f-d8cf207d02e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:45.923785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a58bd6-0741-4d01-990f-d8cf207d02e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:45.924063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a58bd6-0741-4d01-990f-d8cf207d02e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:45.932977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a58bd6-0741-4d01-990f-d8cf207d02e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:45.934401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a58bd6-0741-4d01-990f-d8cf207d02e1 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:45.943806 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 723/1443] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:48.351764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d60c9-b0dc-46d9-8dc6-01e2d6ebc45d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:48.352324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d60c9-b0dc-46d9-8dc6-01e2d6ebc45d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:48.352324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d60c9-b0dc-46d9-8dc6-01e2d6ebc45d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:48.353697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:20:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:48.359186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10f563-6ef9-48c2-a28c-8f1709bef4cb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:48.359699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10f563-6ef9-48c2-a28c-8f1709bef4cb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:48.359800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10f563-6ef9-48c2-a28c-8f1709bef4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:48.377572 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6e10f563-6ef9-48c2-a28c-8f1709bef4cb None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:48.379429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6e10f563-6ef9-48c2-a28c-8f1709bef4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:48.387416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:48.426755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d60c9-b0dc-46d9-8dc6-01e2d6ebc45d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:48.437329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d60c9-b0dc-46d9-8dc6-01e2d6ebc45d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:48.440822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670de63-8f3e-4c80-bc16-a58503482338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:48.441443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670de63-8f3e-4c80-bc16-a58503482338 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:48.441725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670de63-8f3e-4c80-bc16-a58503482338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:48.442000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670de63-8f3e-4c80-bc16-a58503482338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:48.450714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670de63-8f3e-4c80-bc16-a58503482338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:48.452192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670de63-8f3e-4c80-bc16-a58503482338 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:48.461960 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 722/1446] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:51.097336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c5f6-293e-464e-b205-6c65c338d706 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:51.097884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c5f6-293e-464e-b205-6c65c338d706 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:51.097884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c5f6-293e-464e-b205-6c65c338d706 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:51.099291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:20:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:51.104822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cb293-9c7f-480c-b252-e431a33b231b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:51.105243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cb293-9c7f-480c-b252-e431a33b231b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:51.105381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cb293-9c7f-480c-b252-e431a33b231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:51.123941 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-706cb293-9c7f-480c-b252-e431a33b231b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:51.125198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-706cb293-9c7f-480c-b252-e431a33b231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:51.133413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:51.171355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c5f6-293e-464e-b205-6c65c338d706 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:51.182547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c5f6-293e-464e-b205-6c65c338d706 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:51.186266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098396d1-724d-4507-88bd-cfedf1444b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:51.186906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098396d1-724d-4507-88bd-cfedf1444b23 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:51.187187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098396d1-724d-4507-88bd-cfedf1444b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:51.187461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098396d1-724d-4507-88bd-cfedf1444b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:51.197046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098396d1-724d-4507-88bd-cfedf1444b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:51.198491 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098396d1-724d-4507-88bd-cfedf1444b23 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:51.207932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 726/1449] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:53.585182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402afe46-d2dc-4836-8485-7b1cdc7d46e2 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:53.585791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402afe46-d2dc-4836-8485-7b1cdc7d46e2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:53.585791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402afe46-d2dc-4836-8485-7b1cdc7d46e2 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:53.587153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:20:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:53.592611 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45992-c736-4d68-acf8-86eab760c31b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:53.593055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45992-c736-4d68-acf8-86eab760c31b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:53.593206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc45992-c736-4d68-acf8-86eab760c31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:53.611917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fbc45992-c736-4d68-acf8-86eab760c31b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:53.613111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fbc45992-c736-4d68-acf8-86eab760c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:53.620784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:53.659119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402afe46-d2dc-4836-8485-7b1cdc7d46e2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:53.669819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402afe46-d2dc-4836-8485-7b1cdc7d46e2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:53.673928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa920a-dfa1-4b6d-8e44-e44b60cdbaeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:53.674558 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa920a-dfa1-4b6d-8e44-e44b60cdbaeb service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:53.674836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa920a-dfa1-4b6d-8e44-e44b60cdbaeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:53.675115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa920a-dfa1-4b6d-8e44-e44b60cdbaeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:53.684372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa920a-dfa1-4b6d-8e44-e44b60cdbaeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:53.685794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa920a-dfa1-4b6d-8e44-e44b60cdbaeb service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:53.695899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 725/1452] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:56.038509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c8cc9-cf38-45cf-90fc-a1962ead1e69 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:56.039050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c8cc9-cf38-45cf-90fc-a1962ead1e69 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:56.039050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c8cc9-cf38-45cf-90fc-a1962ead1e69 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:56.040396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:20:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:56.045952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624566c-db5e-4d23-8a88-a4056e80c0a6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:56.046394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624566c-db5e-4d23-8a88-a4056e80c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:56.046524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624566c-db5e-4d23-8a88-a4056e80c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:56.064653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4624566c-db5e-4d23-8a88-a4056e80c0a6 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:56.065858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4624566c-db5e-4d23-8a88-a4056e80c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:56.074084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:56.112926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c8cc9-cf38-45cf-90fc-a1962ead1e69 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:56.123634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c8cc9-cf38-45cf-90fc-a1962ead1e69 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:56.127136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b86e8-faa6-46ae-90df-5714f25f1f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:56.127802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b86e8-faa6-46ae-90df-5714f25f1f30 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:56.128083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b86e8-faa6-46ae-90df-5714f25f1f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:56.128358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b86e8-faa6-46ae-90df-5714f25f1f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:56.137284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b86e8-faa6-46ae-90df-5714f25f1f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:56.138717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b86e8-faa6-46ae-90df-5714f25f1f30 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:56.148093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 729/1455] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:20:58.443188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534af3-61ab-4692-86ec-e7058bc160a9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:58.443749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534af3-61ab-4692-86ec-e7058bc160a9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:58.443749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534af3-61ab-4692-86ec-e7058bc160a9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:58.445060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:20:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:20:58.450297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8aa7a-1029-4ad3-bfcf-3cc393e2f2d7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:58.450705 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8aa7a-1029-4ad3-bfcf-3cc393e2f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:58.450864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8aa7a-1029-4ad3-bfcf-3cc393e2f2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:58.468669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6ba8aa7a-1029-4ad3-bfcf-3cc393e2f2d7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:20:58.469854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6ba8aa7a-1029-4ad3-bfcf-3cc393e2f2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:20:58.477514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:20:58.515056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2534af3-61ab-4692-86ec-e7058bc160a9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:20:58.526605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2534af3-61ab-4692-86ec-e7058bc160a9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:20:58.530119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaec61-c83e-413e-816c-5909a2ac0c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:20:58.530744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaec61-c83e-413e-816c-5909a2ac0c45 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:20:58.531028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaec61-c83e-413e-816c-5909a2ac0c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:20:58.531305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaec61-c83e-413e-816c-5909a2ac0c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:20:58.540413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaec61-c83e-413e-816c-5909a2ac0c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:20:58.541841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaec61-c83e-413e-816c-5909a2ac0c45 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:20:58.551200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 728/1458] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:21:00.837548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd475c-b861-4b33-8c33-55bf7c3f0515 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:00.838129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd475c-b861-4b33-8c33-55bf7c3f0515 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:00.838129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd475c-b861-4b33-8c33-55bf7c3f0515 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:00.839516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:21:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:00.845085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0099a-70a5-4492-88f5-ce56a66724cf None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:00.845521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0099a-70a5-4492-88f5-ce56a66724cf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:00.845635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0099a-70a5-4492-88f5-ce56a66724cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:00.863742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-62d0099a-70a5-4492-88f5-ce56a66724cf None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:00.864937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-62d0099a-70a5-4492-88f5-ce56a66724cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:00.872737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:00.909878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd475c-b861-4b33-8c33-55bf7c3f0515 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:00.920693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd475c-b861-4b33-8c33-55bf7c3f0515 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:00.924730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4405f-2606-41d9-b88d-6102cf309dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:00.925355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4405f-2606-41d9-b88d-6102cf309dce service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:00.925634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4405f-2606-41d9-b88d-6102cf309dce service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:00.925908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4405f-2606-41d9-b88d-6102cf309dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:00.934718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4405f-2606-41d9-b88d-6102cf309dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:00.936180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4405f-2606-41d9-b88d-6102cf309dce service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:00.946079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 732/1461] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:21:03.241214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df36a60-9276-44e3-a0db-b2097f69cc87 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:03.241776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df36a60-9276-44e3-a0db-b2097f69cc87 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:03.241776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df36a60-9276-44e3-a0db-b2097f69cc87 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:03.243117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:21:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:03.248458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d5575-2eaf-4b68-99cc-eea707a0aefd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:03.248921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d5575-2eaf-4b68-99cc-eea707a0aefd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:03.249042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d5575-2eaf-4b68-99cc-eea707a0aefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:03.255664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=79 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:03.268576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e13d5575-2eaf-4b68-99cc-eea707a0aefd None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:03.269789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e13d5575-2eaf-4b68-99cc-eea707a0aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:03.277572 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:03.316599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df36a60-9276-44e3-a0db-b2097f69cc87 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:03.318291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9df36a60-9276-44e3-a0db-b2097f69cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:03.325935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=73 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:03.332470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df36a60-9276-44e3-a0db-b2097f69cc87 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:03.340641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5dcb56-bfdd-4606-9409-07372dd39e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:03.343445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dcb56-bfdd-4606-9409-07372dd39e37 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:03.343763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dcb56-bfdd-4606-9409-07372dd39e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:03.344067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dcb56-bfdd-4606-9409-07372dd39e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:03.352996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5dcb56-bfdd-4606-9409-07372dd39e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:03.354422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5dcb56-bfdd-4606-9409-07372dd39e37 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:03.364687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 731/1464] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:21:05.681181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d926904-d940-4768-8087-d53a16874608 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:05.681734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d926904-d940-4768-8087-d53a16874608 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:05.681849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d926904-d940-4768-8087-d53a16874608 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:05.683253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:21:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:05.689354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b3d68-7ce9-432b-94c7-de33597b6065 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:05.689790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b3d68-7ce9-432b-94c7-de33597b6065 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:05.689918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b3d68-7ce9-432b-94c7-de33597b6065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:05.708441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0e0b3d68-7ce9-432b-94c7-de33597b6065 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:05.709650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0e0b3d68-7ce9-432b-94c7-de33597b6065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:05.718025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:05.755361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d926904-d940-4768-8087-d53a16874608 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:05.766028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d926904-d940-4768-8087-d53a16874608 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:05.769524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ffc1-aa98-4c1a-aa99-484164b594c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:05.770155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ffc1-aa98-4c1a-aa99-484164b594c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:05.770435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ffc1-aa98-4c1a-aa99-484164b594c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:05.770711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ffc1-aa98-4c1a-aa99-484164b594c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:05.779593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15ffc1-aa98-4c1a-aa99-484164b594c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:05.781021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15ffc1-aa98-4c1a-aa99-484164b594c2 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:05.790854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 735/1467] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:21:08.070579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816952-b2f7-47f5-8922-2ad2040d8613 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:08.071111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816952-b2f7-47f5-8922-2ad2040d8613 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:08.071111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816952-b2f7-47f5-8922-2ad2040d8613 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:08.072470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:21:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:08.077704 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47976-a85b-46bc-a5d7-1bbe6ce72998 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:08.078146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47976-a85b-46bc-a5d7-1bbe6ce72998 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:08.078283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba47976-a85b-46bc-a5d7-1bbe6ce72998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:08.096396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2ba47976-a85b-46bc-a5d7-1bbe6ce72998 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:08.097593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2ba47976-a85b-46bc-a5d7-1bbe6ce72998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:08.105322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:08.143399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816952-b2f7-47f5-8922-2ad2040d8613 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:08.154611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816952-b2f7-47f5-8922-2ad2040d8613 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:08.158195 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16a91c-c639-415b-a6fb-bef63adf3c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:08.158825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16a91c-c639-415b-a6fb-bef63adf3c00 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:08.159103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16a91c-c639-415b-a6fb-bef63adf3c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:08.159376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16a91c-c639-415b-a6fb-bef63adf3c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:08.168899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16a91c-c639-415b-a6fb-bef63adf3c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:08.170344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16a91c-c639-415b-a6fb-bef63adf3c00 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:08.180111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 734/1470] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:21:18.091319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=11 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:18.176176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=14 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:40.022868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d91dc6-b1cf-41f4-a74a-46bcdceba33b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:40.023437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d91dc6-b1cf-41f4-a74a-46bcdceba33b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:40.023437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d91dc6-b1cf-41f4-a74a-46bcdceba33b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:40.024786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 737/1471] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:21:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:40.030268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf2db-81a0-4db5-805c-05e49fae1be1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:40.030761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf2db-81a0-4db5-805c-05e49fae1be1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:40.031417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf2db-81a0-4db5-805c-05e49fae1be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:40.050514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2a4bf2db-81a0-4db5-805c-05e49fae1be1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:40.051777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2a4bf2db-81a0-4db5-805c-05e49fae1be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:40.060010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 735/1472] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:40.108966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07725ebc-32dc-4e7b-9eae-7ffd2b3f3148 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:40.109253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07725ebc-32dc-4e7b-9eae-7ffd2b3f3148 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:40.109529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07725ebc-32dc-4e7b-9eae-7ffd2b3f3148 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:40.110881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 738/1473] 10.222.0.112 () {54 vars in 967 bytes} [Fri Jun 3 16:21:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:40.115807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a045b4-c1f4-4ff1-a7c8-682d73d09e9d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:40.116103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a045b4-c1f4-4ff1-a7c8-682d73d09e9d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:40.116386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a045b4-c1f4-4ff1-a7c8-682d73d09e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:40.134980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-80a045b4-c1f4-4ff1-a7c8-682d73d09e9d None None] MFA Rules not processed for user `5f440bbc0414415186ae83d9fa3842bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:40.136236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-80a045b4-c1f4-4ff1-a7c8-682d73d09e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:40.143607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 736/1474] 10.222.0.112 () {58 vars in 1064 bytes} [Fri Jun 3 16:21:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:40.153617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07725ebc-32dc-4e7b-9eae-7ffd2b3f3148 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:40.165484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07725ebc-32dc-4e7b-9eae-7ffd2b3f3148 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:40.169403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c434a4-971c-423f-983f-35c8dac5184e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f440bbc0414415186ae83d9fa3842bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:40.170053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c434a4-971c-423f-983f-35c8dac5184e service glance] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:40.170336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c434a4-971c-423f-983f-35c8dac5184e service glance] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:40.170613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c434a4-971c-423f-983f-35c8dac5184e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:40.180983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c434a4-971c-423f-983f-35c8dac5184e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:40.182427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c434a4-971c-423f-983f-35c8dac5184e service glance] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:40.192241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 739/1475] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:21:42.586459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a92f3-944c-48ed-b80d-0670918083cd None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:42.587041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a92f3-944c-48ed-b80d-0670918083cd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:42.587041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a92f3-944c-48ed-b80d-0670918083cd None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:42.588342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 737/1476] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:21:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:42.594585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e6cff-dc72-4b9f-a16d-8488aa8cf8e1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:42.595080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e6cff-dc72-4b9f-a16d-8488aa8cf8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:42.595179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e6cff-dc72-4b9f-a16d-8488aa8cf8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:42.613388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6a4e6cff-dc72-4b9f-a16d-8488aa8cf8e1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:42.614580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6a4e6cff-dc72-4b9f-a16d-8488aa8cf8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:42.622353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 740/1477] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:42.645337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a92f3-944c-48ed-b80d-0670918083cd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:42.658749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a92f3-944c-48ed-b80d-0670918083cd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:42.663408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf1882-0267-4aa2-8891-29d3d4e733a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:42.664095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf1882-0267-4aa2-8891-29d3d4e733a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:42.664379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf1882-0267-4aa2-8891-29d3d4e733a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:42.664656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf1882-0267-4aa2-8891-29d3d4e733a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:42.665449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf1882-0267-4aa2-8891-29d3d4e733a8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:42.667246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING py.warnings [None req-e7bf1882-0267-4aa2-8891-29d3d4e733a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:21:42.667246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 16:21:42.667246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: Jun 03 16:21:42.668435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf1882-0267-4aa2-8891-29d3d4e733a8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:42.688806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 738/1478] 10.222.0.112 () {56 vars in 1113 bytes} [Fri Jun 3 16:21:42 2022] GET /identity/v3/projects => generated 2562 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:21:45.016772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6449efb-0bf3-4a3c-aa91-372f5bf1cf17 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:45.017492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6449efb-0bf3-4a3c-aa91-372f5bf1cf17 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:45.017492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6449efb-0bf3-4a3c-aa91-372f5bf1cf17 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:45.018719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 741/1479] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:21:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:45.024730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6845c1-ae2b-48f0-adeb-019b0e5c9592 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:45.025385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6845c1-ae2b-48f0-adeb-019b0e5c9592 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:45.025385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6845c1-ae2b-48f0-adeb-019b0e5c9592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:45.047316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4b6845c1-ae2b-48f0-adeb-019b0e5c9592 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:45.048595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4b6845c1-ae2b-48f0-adeb-019b0e5c9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:45.056662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 739/1480] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:45.103275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6449efb-0bf3-4a3c-aa91-372f5bf1cf17 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:45.120135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6449efb-0bf3-4a3c-aa91-372f5bf1cf17 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:45.126225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1c7a-157b-4513-9236-d66e8d6081c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:45.126871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1c7a-157b-4513-9236-d66e8d6081c8 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:45.127153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1c7a-157b-4513-9236-d66e8d6081c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:45.127439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1c7a-157b-4513-9236-d66e8d6081c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:45.136313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be1c7a-157b-4513-9236-d66e8d6081c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:45.137942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be1c7a-157b-4513-9236-d66e8d6081c8 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:45.148080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 742/1481] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:21:47.630063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49db52-7334-429d-ad91-b7daf14aca95 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:47.630651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49db52-7334-429d-ad91-b7daf14aca95 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:47.630651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49db52-7334-429d-ad91-b7daf14aca95 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:47.632108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 740/1482] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:21:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:47.638478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047407-1117-41fb-b81f-7c4fbd3f6fd7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:47.639114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047407-1117-41fb-b81f-7c4fbd3f6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:47.639114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2047407-1117-41fb-b81f-7c4fbd3f6fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:47.660242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f2047407-1117-41fb-b81f-7c4fbd3f6fd7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:47.661471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f2047407-1117-41fb-b81f-7c4fbd3f6fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:47.669858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 743/1483] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:47.708771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49db52-7334-429d-ad91-b7daf14aca95 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:47.720942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49db52-7334-429d-ad91-b7daf14aca95 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:47.724708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924a482-9b55-4889-be7e-caa59a3c84e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:47.725377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924a482-9b55-4889-be7e-caa59a3c84e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:47.725645 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924a482-9b55-4889-be7e-caa59a3c84e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:47.725921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924a482-9b55-4889-be7e-caa59a3c84e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:47.736825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924a482-9b55-4889-be7e-caa59a3c84e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:47.738281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924a482-9b55-4889-be7e-caa59a3c84e4 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:47.748818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 741/1484] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:21:50.108388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac516b-ff01-481d-bf17-76d65e094e55 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:50.108969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac516b-ff01-481d-bf17-76d65e094e55 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:50.108969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac516b-ff01-481d-bf17-76d65e094e55 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:50.110670 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 744/1485] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:21:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:50.116899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f425b-5eec-4462-8e48-caac06d4e9e8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:50.117482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f425b-5eec-4462-8e48-caac06d4e9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:50.117482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f425b-5eec-4462-8e48-caac06d4e9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:50.136974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6c2f425b-5eec-4462-8e48-caac06d4e9e8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:50.138203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6c2f425b-5eec-4462-8e48-caac06d4e9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:50.148719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 742/1486] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:50.189348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac516b-ff01-481d-bf17-76d65e094e55 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:50.209048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac516b-ff01-481d-bf17-76d65e094e55 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:50.214105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149b95-a5ca-400d-ab79-4192426ab04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:50.214768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149b95-a5ca-400d-ab79-4192426ab04a service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:50.215052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149b95-a5ca-400d-ab79-4192426ab04a service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:50.215417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149b95-a5ca-400d-ab79-4192426ab04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:50.228002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61149b95-a5ca-400d-ab79-4192426ab04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:50.230240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61149b95-a5ca-400d-ab79-4192426ab04a service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:50.243961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 745/1487] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:21:52.727897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b82492-e805-4291-a01e-ee72d9d22ec5 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:52.728488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b82492-e805-4291-a01e-ee72d9d22ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:52.728488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b82492-e805-4291-a01e-ee72d9d22ec5 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:52.730266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 743/1488] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:21:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:52.737103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c69db0-4d90-48b4-9053-888f704ea174 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:52.737694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c69db0-4d90-48b4-9053-888f704ea174 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:52.737694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c69db0-4d90-48b4-9053-888f704ea174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:52.757623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-29c69db0-4d90-48b4-9053-888f704ea174 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:52.758881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-29c69db0-4d90-48b4-9053-888f704ea174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:52.767395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 746/1489] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:52.808147 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b82492-e805-4291-a01e-ee72d9d22ec5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:52.820088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b82492-e805-4291-a01e-ee72d9d22ec5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:52.823933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369d5cd-18f1-4ef1-a463-b2d396dd6ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:52.824586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369d5cd-18f1-4ef1-a463-b2d396dd6ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:52.824865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369d5cd-18f1-4ef1-a463-b2d396dd6ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:52.825142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369d5cd-18f1-4ef1-a463-b2d396dd6ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:52.835291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369d5cd-18f1-4ef1-a463-b2d396dd6ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:52.836884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369d5cd-18f1-4ef1-a463-b2d396dd6ed6 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:52.848031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 744/1490] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:21:55.462215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076489a-a601-476a-8a06-6e189314e859 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:55.462982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076489a-a601-476a-8a06-6e189314e859 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:55.462982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076489a-a601-476a-8a06-6e189314e859 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:55.464146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 747/1491] 10.222.0.112 () {54 vars in 931 bytes} [Fri Jun 3 16:21:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:21:55.473422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efdab7-3859-42e2-b9ab-f0dede2f24eb None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:55.474124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efdab7-3859-42e2-b9ab-f0dede2f24eb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:55.474124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efdab7-3859-42e2-b9ab-f0dede2f24eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:55.494219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d0efdab7-3859-42e2-b9ab-f0dede2f24eb None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:21:55.495474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d0efdab7-3859-42e2-b9ab-f0dede2f24eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:21:55.504004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 745/1492] 10.222.0.112 () {58 vars in 1028 bytes} [Fri Jun 3 16:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:21:55.570789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076489a-a601-476a-8a06-6e189314e859 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:21:55.583184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076489a-a601-476a-8a06-6e189314e859 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:21:55.586955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3792ce1-ded5-4f6e-a963-c11e53df3061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:21:55.587658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3792ce1-ded5-4f6e-a963-c11e53df3061 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:21:55.587945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3792ce1-ded5-4f6e-a963-c11e53df3061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:21:55.588224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3792ce1-ded5-4f6e-a963-c11e53df3061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:21:55.599143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3792ce1-ded5-4f6e-a963-c11e53df3061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:21:55.600690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3792ce1-ded5-4f6e-a963-c11e53df3061 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:21:55.611925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 748/1493] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:22:05.488413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=33 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:05.607034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=33 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:40.068263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae1140-09f5-416d-b6cc-d888f1f32582 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.073728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae1140-09f5-416d-b6cc-d888f1f32582 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.073728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae1140-09f5-416d-b6cc-d888f1f32582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.088536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6cae1140-09f5-416d-b6cc-d888f1f32582 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:23:40.089743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6cae1140-09f5-416d-b6cc-d888f1f32582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:23:40.098190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 746/1494] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:23:40.106283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e951c-1702-4dfa-a692-c3d03016a74e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.106788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e951c-1702-4dfa-a692-c3d03016a74e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.106916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e951c-1702-4dfa-a692-c3d03016a74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.125277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2c6e951c-1702-4dfa-a692-c3d03016a74e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:23:40.126457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2c6e951c-1702-4dfa-a692-c3d03016a74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:23:40.134212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 749/1495] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:23:40.138718 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae1140-09f5-416d-b6cc-d888f1f32582 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:40.149721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae1140-09f5-416d-b6cc-d888f1f32582 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:40.154330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:40.154975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.155259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.155578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.156317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:23:40.156628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:40.157661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING py.warnings [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:23:40.157661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 16:23:40.157661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: Jun 03 16:23:40.158554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:40.170682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 747/1496] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:23:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:23:40.178909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e951c-1702-4dfa-a692-c3d03016a74e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:40.188778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e951c-1702-4dfa-a692-c3d03016a74e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:40.193401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34df374-128f-42a8-a044-79bf5ddb197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:40.194009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df374-128f-42a8-a044-79bf5ddb197f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.194293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df374-128f-42a8-a044-79bf5ddb197f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.194570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df374-128f-42a8-a044-79bf5ddb197f admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.195259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34df374-128f-42a8-a044-79bf5ddb197f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:40.197042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WARNING py.warnings [None req-c34df374-128f-42a8-a044-79bf5ddb197f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:23:40.197042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 16:23:40.197042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: Jun 03 16:23:40.198228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34df374-128f-42a8-a044-79bf5ddb197f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:40.236845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 750/1497] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:23:40 2022] POST /identity/v3/projects => generated 378 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:23:40.242209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:40.252762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e6437-6678-4d93-931f-9a22f38b7a1f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:40.307033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a01536-3a38-4fe4-9317-9a7c74994b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:40.307720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a01536-3a38-4fe4-9317-9a7c74994b2c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.308006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a01536-3a38-4fe4-9317-9a7c74994b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.308282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a01536-3a38-4fe4-9317-9a7c74994b2c admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.308966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a01536-3a38-4fe4-9317-9a7c74994b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:40.309974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING py.warnings [None req-49a01536-3a38-4fe4-9317-9a7c74994b2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:23:40.309974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 16:23:40.309974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: Jun 03 16:23:40.311176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a01536-3a38-4fe4-9317-9a7c74994b2c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:40.331162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 748/1498] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:23:40 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:23:40.335445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34df374-128f-42a8-a044-79bf5ddb197f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:40.346289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34df374-128f-42a8-a044-79bf5ddb197f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:40.350796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584618b8-84b6-46d7-8f41-139f5ffec1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:40.351477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584618b8-84b6-46d7-8f41-139f5ffec1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.351793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584618b8-84b6-46d7-8f41-139f5ffec1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.352070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584618b8-84b6-46d7-8f41-139f5ffec1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.352794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584618b8-84b6-46d7-8f41-139f5ffec1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:40.353839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WARNING py.warnings [None req-584618b8-84b6-46d7-8f41-139f5ffec1b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:23:40.353839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 16:23:40.353839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: Jun 03 16:23:40.354719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584618b8-84b6-46d7-8f41-139f5ffec1b2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:40.368203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 751/1499] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:23:40 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:23:40.372332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a01536-3a38-4fe4-9317-9a7c74994b2c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:40.382275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a01536-3a38-4fe4-9317-9a7c74994b2c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:40.386873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629b3f1-5042-40e9-b9cc-1147e56e9bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:40.387523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629b3f1-5042-40e9-b9cc-1147e56e9bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.387841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629b3f1-5042-40e9-b9cc-1147e56e9bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.388123 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629b3f1-5042-40e9-b9cc-1147e56e9bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.388848 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629b3f1-5042-40e9-b9cc-1147e56e9bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:40.389863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING py.warnings [None req-4629b3f1-5042-40e9-b9cc-1147e56e9bb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:23:40.389863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 16:23:40.389863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: Jun 03 16:23:40.390746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629b3f1-5042-40e9-b9cc-1147e56e9bb9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:40.403944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 749/1500] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:23:40 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:23:40.408874 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584618b8-84b6-46d7-8f41-139f5ffec1b2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:40.420945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584618b8-84b6-46d7-8f41-139f5ffec1b2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:40.426150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960a54b-a74a-45d6-a0e4-48b7dbd6c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:40.427021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960a54b-a74a-45d6-a0e4-48b7dbd6c9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.427301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960a54b-a74a-45d6-a0e4-48b7dbd6c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.427596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960a54b-a74a-45d6-a0e4-48b7dbd6c9d5 admin admin] PATH_INFO: `/v3/projects/328512c4d885419ebb984193ab64ab3c/users/8865bb8c5d474594b498f95fbf5828aa/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.443143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960a54b-a74a-45d6-a0e4-48b7dbd6c9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328512c4d885419ebb984193ab64ab3c, user_id=8865bb8c5d474594b498f95fbf5828aa, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:40.444229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WARNING py.warnings [None req-f960a54b-a74a-45d6-a0e4-48b7dbd6c9d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:23:40.444229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 16:23:40.444229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: Jun 03 16:23:40.446139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960a54b-a74a-45d6-a0e4-48b7dbd6c9d5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:40.458485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 752/1501] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:23:40 2022] PUT /identity/v3/projects/328512c4d885419ebb984193ab64ab3c/users/8865bb8c5d474594b498f95fbf5828aa/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:23:40.471118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15ad52-19b4-486b-a4a5-47f5455bc5ef None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.471405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15ad52-19b4-486b-a4a5-47f5455bc5ef None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.471740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15ad52-19b4-486b-a4a5-47f5455bc5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.502534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6d15ad52-19b4-486b-a4a5-47f5455bc5ef None None] MFA Rules not processed for user `8865bb8c5d474594b498f95fbf5828aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:23:40.503804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6d15ad52-19b4-486b-a4a5-47f5455bc5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:23:40.568097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 750/1502] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:23:40.581832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0917-4976-404f-8a6f-62edab151607 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.582063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0917-4976-404f-8a6f-62edab151607 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.582335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0917-4976-404f-8a6f-62edab151607 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.583721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 753/1503] 10.222.0.112 () {54 vars in 968 bytes} [Fri Jun 3 16:23:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:23:40.588785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d278-f35f-4a5a-a190-1d0ed230ef50 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.589077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d278-f35f-4a5a-a190-1d0ed230ef50 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.589356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8d278-f35f-4a5a-a190-1d0ed230ef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.608141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-58c8d278-f35f-4a5a-a190-1d0ed230ef50 None None] MFA Rules not processed for user `8571493023904002bd334e74441d134d`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:23:40.609356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-58c8d278-f35f-4a5a-a190-1d0ed230ef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:23:40.652356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:40.661769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 751/1504] 10.222.0.112 () {58 vars in 1065 bytes} [Fri Jun 3 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:23:40.669456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0917-4976-404f-8a6f-62edab151607 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:40.680144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0917-4976-404f-8a6f-62edab151607 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:40.683641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178a523-bf3d-437c-9dfa-57cbb9abaf4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:40.684274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178a523-bf3d-437c-9dfa-57cbb9abaf4e service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.684558 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178a523-bf3d-437c-9dfa-57cbb9abaf4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.684835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178a523-bf3d-437c-9dfa-57cbb9abaf4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.693532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178a523-bf3d-437c-9dfa-57cbb9abaf4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:40.694950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178a523-bf3d-437c-9dfa-57cbb9abaf4e service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:40.704151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 754/1505] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:23:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:23:40.745573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bcf3e-f005-4d27-8eb4-cb7a4080afd9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.745868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bcf3e-f005-4d27-8eb4-cb7a4080afd9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.746154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bcf3e-f005-4d27-8eb4-cb7a4080afd9 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.747447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 752/1506] 10.222.0.112 () {52 vars in 834 bytes} [Fri Jun 3 16:23:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:23:40.751105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178a523-bf3d-437c-9dfa-57cbb9abaf4e service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:40.812972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178a523-bf3d-437c-9dfa-57cbb9abaf4e service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:40.817450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:40.818310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.818591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.818863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] PATH_INFO: `/v3/users/8865bb8c5d474594b498f95fbf5828aa` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.820151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8865bb8c5d474594b498f95fbf5828aa)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:40.821170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WARNING py.warnings [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:23:40.821170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 16:23:40.821170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: Jun 03 16:23:40.822374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:40.888969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8865bb8c5d474594b498f95fbf5828aa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:40.889653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8865bb8c5d474594b498f95fbf5828aa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:40.908790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8865bb8c5d474594b498f95fbf5828aa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:40.921027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8865bb8c5d474594b498f95fbf5828aa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:40.921837 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8865bb8c5d474594b498f95fbf5828aa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:40.925844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:40.939427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 755/1507] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:23:40 2022] DELETE /identity/v3/users/8865bb8c5d474594b498f95fbf5828aa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:23:40.944145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ce39-da6a-4487-b17c-6346e6119052 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:40.944571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ce39-da6a-4487-b17c-6346e6119052 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:40.944928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ce39-da6a-4487-b17c-6346e6119052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:40.964133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1ac4ce39-da6a-4487-b17c-6346e6119052 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:23:40.965413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1ac4ce39-da6a-4487-b17c-6346e6119052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:23:41.023616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 753/1508] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:23:41.033043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:41.034462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:23:41.090444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85e80-bd49-4f0c-8115-3ad01027b61c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:41.093990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d096246-13b7-476f-aac8-7d9ae946fac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:41.094626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096246-13b7-476f-aac8-7d9ae946fac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:41.094905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096246-13b7-476f-aac8-7d9ae946fac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:41.095178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096246-13b7-476f-aac8-7d9ae946fac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:41.104030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d096246-13b7-476f-aac8-7d9ae946fac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:41.105901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d096246-13b7-476f-aac8-7d9ae946fac2 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:41.115465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 756/1509] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:23:41.438352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4ce39-da6a-4487-b17c-6346e6119052 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:23:41.440024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1ac4ce39-da6a-4487-b17c-6346e6119052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:23:41.452021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4ce39-da6a-4487-b17c-6346e6119052 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:23:41.456758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:23:41.457635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:23:41.457959 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:23:41.458244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] PATH_INFO: `/v3/projects/328512c4d885419ebb984193ab64ab3c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:23:41.459609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=328512c4d885419ebb984193ab64ab3c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:23:41.460709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING py.warnings [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:23:41.460709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 16:23:41.460709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: Jun 03 16:23:41.461806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:23:41.534163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328512c4d885419ebb984193ab64ab3c', 'request_id': 'req-451effbd-7a1f-43af-b51d-5ecb3f05e41b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:41.548351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328512c4d885419ebb984193ab64ab3c', 'request_id': 'req-451effbd-7a1f-43af-b51d-5ecb3f05e41b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:41.559104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328512c4d885419ebb984193ab64ab3c', 'request_id': 'req-451effbd-7a1f-43af-b51d-5ecb3f05e41b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:41.572462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] The token cache is being invalidate because project 328512c4d885419ebb984193ab64ab3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:23:41.573093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:41.573907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-451effbd-7a1f-43af-b51d-5ecb3f05e41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:23:41.576031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 754/1510] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:23:41 2022] DELETE /identity/v3/projects/328512c4d885419ebb984193ab64ab3c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:23:51.111347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:51.568757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:28.190589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd885d4-318b-4554-8d3e-a8a2ec500531 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:28.191328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd885d4-318b-4554-8d3e-a8a2ec500531 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:28.191328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd885d4-318b-4554-8d3e-a8a2ec500531 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:28.193097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:25:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:25:28.198156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e39669-312d-4b1e-844e-128a33307235 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:28.198599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e39669-312d-4b1e-844e-128a33307235 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:28.198707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e39669-312d-4b1e-844e-128a33307235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:28.217672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-89e39669-312d-4b1e-844e-128a33307235 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:28.218894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-89e39669-312d-4b1e-844e-128a33307235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:28.288055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:25:28.459760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd885d4-318b-4554-8d3e-a8a2ec500531 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:25:28.461460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-abd885d4-318b-4554-8d3e-a8a2ec500531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:28.537114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd885d4-318b-4554-8d3e-a8a2ec500531 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:25:28.542639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202ec38-54bd-4648-a3f7-7efeefc5952c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:25:28.543300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202ec38-54bd-4648-a3f7-7efeefc5952c service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:28.543631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202ec38-54bd-4648-a3f7-7efeefc5952c service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:28.543917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202ec38-54bd-4648-a3f7-7efeefc5952c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:28.553509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202ec38-54bd-4648-a3f7-7efeefc5952c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:25:28.555115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202ec38-54bd-4648-a3f7-7efeefc5952c service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:25:28.565309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 758/1513] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:25:29.502165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4639-4211-4a93-b9c3-53edd16b6bd9 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:29.502693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4639-4211-4a93-b9c3-53edd16b6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:29.502693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a4639-4211-4a93-b9c3-53edd16b6bd9 None None] PATH_INFO: `/v3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:29.504643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 756/1514] 10.222.0.97 () {54 vars in 929 bytes} [Fri Jun 3 16:25:29 2022] GET /identity/v3 => generated 256 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:25:29.511037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c6d13-ae0f-4dae-ae31-3c715162c029 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:29.511490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c6d13-ae0f-4dae-ae31-3c715162c029 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:29.511624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c6d13-ae0f-4dae-ae31-3c715162c029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:29.513005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64c6a6-6862-48cc-b382-ada5fcb38629 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:29.513297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64c6a6-6862-48cc-b382-ada5fcb38629 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:29.513580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64c6a6-6862-48cc-b382-ada5fcb38629 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:29.514972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 757/1515] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:25:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:25:29.519484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc80c17-ab1b-4650-8edc-8b742c6a025b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:29.520575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc80c17-ab1b-4650-8edc-8b742c6a025b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:29.520869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc80c17-ab1b-4650-8edc-8b742c6a025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:29.531315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f22c6d13-ae0f-4dae-ae31-3c715162c029 None None] MFA Rules not processed for user `88e5d3ba49164f55a063aa60643bd421`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:29.532583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f22c6d13-ae0f-4dae-ae31-3c715162c029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:29.540310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ffc80c17-ab1b-4650-8edc-8b742c6a025b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:29.541763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ffc80c17-ab1b-4650-8edc-8b742c6a025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:29.550085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 758/1516] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:25:29.608338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 759/1517] 10.222.0.97 () {58 vars in 1019 bytes} [Fri Jun 3 16:25:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:25:29.700931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc80c17-ab1b-4650-8edc-8b742c6a025b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:25:29.714888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc80c17-ab1b-4650-8edc-8b742c6a025b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:25:29.720436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a96cb-419d-48f7-8bad-79b834dde9fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:25:29.721082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a96cb-419d-48f7-8bad-79b834dde9fa service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:29.721369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a96cb-419d-48f7-8bad-79b834dde9fa service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:29.721649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a96cb-419d-48f7-8bad-79b834dde9fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:29.730749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a96cb-419d-48f7-8bad-79b834dde9fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:25:29.732689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a96cb-419d-48f7-8bad-79b834dde9fa service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:25:29.743956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 759/1518] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:25:33.560902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cecb91-3496-4f68-b300-60ff0a9fb6d9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:33.561483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cecb91-3496-4f68-b300-60ff0a9fb6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:33.561598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cecb91-3496-4f68-b300-60ff0a9fb6d9 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:33.563343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 760/1519] 10.222.0.112 () {54 vars in 965 bytes} [Fri Jun 3 16:25:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:25:33.570559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4bb30-e14f-440a-b508-0f58696fd858 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:33.571107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4bb30-e14f-440a-b508-0f58696fd858 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:33.571460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4bb30-e14f-440a-b508-0f58696fd858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:33.596215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0ff4bb30-e14f-440a-b508-0f58696fd858 None None] MFA Rules not processed for user `88e5d3ba49164f55a063aa60643bd421`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:33.597429 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0ff4bb30-e14f-440a-b508-0f58696fd858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:33.605942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 760/1520] 10.222.0.112 () {58 vars in 1062 bytes} [Fri Jun 3 16:25:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:25:33.614352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cecb91-3496-4f68-b300-60ff0a9fb6d9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:25:33.628576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cecb91-3496-4f68-b300-60ff0a9fb6d9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:25:33.634759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004b628-03d9-47d9-87d9-bd4baf1b1378 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:25:33.635410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b628-03d9-47d9-87d9-bd4baf1b1378 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:33.635725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b628-03d9-47d9-87d9-bd4baf1b1378 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:33.635999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b628-03d9-47d9-87d9-bd4baf1b1378 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:33.646796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004b628-03d9-47d9-87d9-bd4baf1b1378 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:25:33.649448 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004b628-03d9-47d9-87d9-bd4baf1b1378 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:25:33.659444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 761/1521] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:25:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:25:41.087480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e340-cd4b-4c2e-a145-977fe67ff454 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:41.088047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e340-cd4b-4c2e-a145-977fe67ff454 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:41.088047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e340-cd4b-4c2e-a145-977fe67ff454 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:41.089364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:25:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:25:41.094342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baff5c-ef7b-474a-a379-e293124f17fa None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:41.094789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baff5c-ef7b-474a-a379-e293124f17fa None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:41.094957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baff5c-ef7b-474a-a379-e293124f17fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:41.114247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-91baff5c-ef7b-474a-a379-e293124f17fa None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:41.115458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-91baff5c-ef7b-474a-a379-e293124f17fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:41.123158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:25:41.275273 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0e340-cd4b-4c2e-a145-977fe67ff454 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:25:41.289957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0e340-cd4b-4c2e-a145-977fe67ff454 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:25:41.295469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2370f94-e6a3-4d48-8279-4df0ec262de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:25:41.296185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370f94-e6a3-4d48-8279-4df0ec262de9 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:41.296466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370f94-e6a3-4d48-8279-4df0ec262de9 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:41.296745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370f94-e6a3-4d48-8279-4df0ec262de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:41.305385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2370f94-e6a3-4d48-8279-4df0ec262de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:25:41.306979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2370f94-e6a3-4d48-8279-4df0ec262de9 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:25:41.317013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 762/1524] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:25:42.195099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c405485-a5ad-4a1a-a773-29c06840ac1f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:42.195648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c405485-a5ad-4a1a-a773-29c06840ac1f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:42.195912 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c405485-a5ad-4a1a-a773-29c06840ac1f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:42.197555 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 16:25:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:25:42.202756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d1e7c-38b4-4b3a-978d-5039e6875fa4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:42.203198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d1e7c-38b4-4b3a-978d-5039e6875fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:42.203314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d1e7c-38b4-4b3a-978d-5039e6875fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:42.222586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-399d1e7c-38b4-4b3a-978d-5039e6875fa4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:42.223854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-399d1e7c-38b4-4b3a-978d-5039e6875fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:42.232599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 16:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:25:42.383093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c405485-a5ad-4a1a-a773-29c06840ac1f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:25:42.398526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c405485-a5ad-4a1a-a773-29c06840ac1f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:25:42.404065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c6e29-84f7-440c-9f2a-6440df709c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:25:42.404636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c6e29-84f7-440c-9f2a-6440df709c8c service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:42.404923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c6e29-84f7-440c-9f2a-6440df709c8c service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:42.405195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c6e29-84f7-440c-9f2a-6440df709c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:42.413609 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c6e29-84f7-440c-9f2a-6440df709c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:25:42.415212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c6e29-84f7-440c-9f2a-6440df709c8c service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:25:42.425145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 764/1527] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:25:46.803723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e31e65-63c4-4da8-a307-1b7899cbdfa1 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:46.804351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e31e65-63c4-4da8-a307-1b7899cbdfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:46.804351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e31e65-63c4-4da8-a307-1b7899cbdfa1 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:46.805740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:25:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:25:46.811787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86366a9-ed98-4b0c-bc8a-3884bb4e5a64 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:46.812367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86366a9-ed98-4b0c-bc8a-3884bb4e5a64 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:46.812367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86366a9-ed98-4b0c-bc8a-3884bb4e5a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:46.831329 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d86366a9-ed98-4b0c-bc8a-3884bb4e5a64 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:46.833155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d86366a9-ed98-4b0c-bc8a-3884bb4e5a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:46.841183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:25:46.878945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e31e65-63c4-4da8-a307-1b7899cbdfa1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:25:46.880778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c3e31e65-63c4-4da8-a307-1b7899cbdfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:46.948345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e31e65-63c4-4da8-a307-1b7899cbdfa1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:25:46.953166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccd7a5-7b9e-439b-8aee-c0223c62d0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:25:46.953833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd7a5-7b9e-439b-8aee-c0223c62d0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:46.954123 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd7a5-7b9e-439b-8aee-c0223c62d0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:46.954403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd7a5-7b9e-439b-8aee-c0223c62d0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:46.966388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd7a5-7b9e-439b-8aee-c0223c62d0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:25:46.967869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd7a5-7b9e-439b-8aee-c0223c62d0c5 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:25:46.979260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 765/1530] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:25:49.220130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539539-0344-431e-96e2-95f922dc29ff None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:49.220717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539539-0344-431e-96e2-95f922dc29ff None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:49.220717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539539-0344-431e-96e2-95f922dc29ff None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:49.222057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:25:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:25:49.227493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e290-553d-4582-bd53-f0ec3979330c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:49.227974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e290-553d-4582-bd53-f0ec3979330c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:49.228104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e290-553d-4582-bd53-f0ec3979330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:49.248638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2158e290-553d-4582-bd53-f0ec3979330c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:49.249862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2158e290-553d-4582-bd53-f0ec3979330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:49.258421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:25:49.293751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539539-0344-431e-96e2-95f922dc29ff None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:25:49.304960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539539-0344-431e-96e2-95f922dc29ff None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:25:49.308436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3667bdd-058c-4747-bfdb-833c365abd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:25:49.309060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667bdd-058c-4747-bfdb-833c365abd79 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:49.309337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667bdd-058c-4747-bfdb-833c365abd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:49.309608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667bdd-058c-4747-bfdb-833c365abd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:49.319080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3667bdd-058c-4747-bfdb-833c365abd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:25:49.320528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3667bdd-058c-4747-bfdb-833c365abd79 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:25:49.331407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 767/1533] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:25:53.104017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37058b98-02ee-4e40-888f-3557c1e9767b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:53.104561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37058b98-02ee-4e40-888f-3557c1e9767b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:53.104561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37058b98-02ee-4e40-888f-3557c1e9767b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:53.105951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:25:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:25:53.111705 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360c001-2159-4ec7-8e49-f5fc98ad961f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:53.112167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360c001-2159-4ec7-8e49-f5fc98ad961f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:53.112277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360c001-2159-4ec7-8e49-f5fc98ad961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:53.118479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:53.131478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6360c001-2159-4ec7-8e49-f5fc98ad961f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:53.132694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6360c001-2159-4ec7-8e49-f5fc98ad961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:53.140763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:25:53.416152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37058b98-02ee-4e40-888f-3557c1e9767b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:25:53.417843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-37058b98-02ee-4e40-888f-3557c1e9767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:53.423591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=78 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:53.474860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37058b98-02ee-4e40-888f-3557c1e9767b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:25:53.478394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246490e-1f31-42be-92c1-a47fba7f1741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:25:53.479031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246490e-1f31-42be-92c1-a47fba7f1741 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:53.479314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246490e-1f31-42be-92c1-a47fba7f1741 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:53.479614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246490e-1f31-42be-92c1-a47fba7f1741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:53.488717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246490e-1f31-42be-92c1-a47fba7f1741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:25:53.490693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246490e-1f31-42be-92c1-a47fba7f1741 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:25:53.500010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 768/1536] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:25:55.743447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d65a6-f0a6-4db8-b3e6-083182c1743f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:55.744065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d65a6-f0a6-4db8-b3e6-083182c1743f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:55.744065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d65a6-f0a6-4db8-b3e6-083182c1743f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:55.745413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 16:25:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:25:55.750782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055318b4-0403-4baf-bb8d-d8b3fbc596c2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:55.751180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055318b4-0403-4baf-bb8d-d8b3fbc596c2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:55.751338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055318b4-0403-4baf-bb8d-d8b3fbc596c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:55.769249 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-055318b4-0403-4baf-bb8d-d8b3fbc596c2 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:25:55.770477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-055318b4-0403-4baf-bb8d-d8b3fbc596c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:55.778835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 16:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:25:56.048309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d65a6-f0a6-4db8-b3e6-083182c1743f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:25:56.049968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a94d65a6-f0a6-4db8-b3e6-083182c1743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:25:56.062881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d65a6-f0a6-4db8-b3e6-083182c1743f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:25:56.066373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c7f0-ade0-4c09-ac52-dbef4636b66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:25:56.066999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c7f0-ade0-4c09-ac52-dbef4636b66e service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:25:56.067279 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c7f0-ade0-4c09-ac52-dbef4636b66e service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:25:56.068134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c7f0-ade0-4c09-ac52-dbef4636b66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:25:56.079615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c7f0-ade0-4c09-ac52-dbef4636b66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:25:56.081066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c7f0-ade0-4c09-ac52-dbef4636b66e service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:25:56.091431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 770/1539] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:26:05.764007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=28 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:06.087321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=8 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:29.314905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d434f1-910d-4ada-acd4-4c6e74cd837a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.315970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d434f1-910d-4ada-acd4-4c6e74cd837a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.316447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d434f1-910d-4ada-acd4-4c6e74cd837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.344818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c4d434f1-910d-4ada-acd4-4c6e74cd837a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:29.346361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c4d434f1-910d-4ada-acd4-4c6e74cd837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:29.362534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 770/1540] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:29.372458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993aaa1-5634-4080-b130-dc73c1d593d2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.373419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993aaa1-5634-4080-b130-dc73c1d593d2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.373891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993aaa1-5634-4080-b130-dc73c1d593d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.399225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d993aaa1-5634-4080-b130-dc73c1d593d2 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:29.401093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d993aaa1-5634-4080-b130-dc73c1d593d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:29.410567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 771/1541] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:29.415390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d434f1-910d-4ada-acd4-4c6e74cd837a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:29.427406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d434f1-910d-4ada-acd4-4c6e74cd837a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:29.435531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99630bbe-c163-4b91-aa12-6f5ef93d1d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:29.436620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99630bbe-c163-4b91-aa12-6f5ef93d1d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.437102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99630bbe-c163-4b91-aa12-6f5ef93d1d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.437567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99630bbe-c163-4b91-aa12-6f5ef93d1d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.438495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99630bbe-c163-4b91-aa12-6f5ef93d1d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:29.439004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99630bbe-c163-4b91-aa12-6f5ef93d1d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:29.441212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99630bbe-c163-4b91-aa12-6f5ef93d1d9e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:29.456252 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7711c4-03db-4521-8fac-c7a6d6251360 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.456890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7711c4-03db-4521-8fac-c7a6d6251360 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.457423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7711c4-03db-4521-8fac-c7a6d6251360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.480552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 771/1542] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:29.488169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3b7711c4-03db-4521-8fac-c7a6d6251360 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:29.490723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99630bbe-c163-4b91-aa12-6f5ef93d1d9e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:29.496270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3b7711c4-03db-4521-8fac-c7a6d6251360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:29.502424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99630bbe-c163-4b91-aa12-6f5ef93d1d9e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:29.508525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb068128-4e65-49f7-8a77-edc447382e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:29.509596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb068128-4e65-49f7-8a77-edc447382e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.510092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb068128-4e65-49f7-8a77-edc447382e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.510580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb068128-4e65-49f7-8a77-edc447382e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.511701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb068128-4e65-49f7-8a77-edc447382e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:29.513317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING py.warnings [None req-cb068128-4e65-49f7-8a77-edc447382e41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:27:29.513317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 16:27:29.513317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: Jun 03 16:27:29.514974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb068128-4e65-49f7-8a77-edc447382e41 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:29.518876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 772/1543] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:27:29.527841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4b952-78cf-4f79-b0fc-8862b868aa8b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.528418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4b952-78cf-4f79-b0fc-8862b868aa8b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.528867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4b952-78cf-4f79-b0fc-8862b868aa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.559259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 772/1544] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:29 2022] POST /identity/v3/projects => generated 380 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:27:29.569006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb068128-4e65-49f7-8a77-edc447382e41 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:29.569231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-59f4b952-78cf-4f79-b0fc-8862b868aa8b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:29.570443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-59f4b952-78cf-4f79-b0fc-8862b868aa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:29.684498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb068128-4e65-49f7-8a77-edc447382e41 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:29.696938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7ba68-5255-456c-8f7a-376d0d2a5254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:29.698055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7ba68-5255-456c-8f7a-376d0d2a5254 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.698576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7ba68-5255-456c-8f7a-376d0d2a5254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.699105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7ba68-5255-456c-8f7a-376d0d2a5254 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.700141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7ba68-5255-456c-8f7a-376d0d2a5254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:29.701583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 773/1545] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:27:29.703141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7ba68-5255-456c-8f7a-376d0d2a5254 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:29.714057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4b952-78cf-4f79-b0fc-8862b868aa8b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:29.729953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4b952-78cf-4f79-b0fc-8862b868aa8b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:29.743630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 773/1546] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:29 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:27:29.747722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7ba68-5255-456c-8f7a-376d0d2a5254 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:29.764902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7ba68-5255-456c-8f7a-376d0d2a5254 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:29.770831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:29.770831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.770831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.770831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.771314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:29.771314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:29.771314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WARNING py.warnings [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:27:29.771314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 16:27:29.771314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: Jun 03 16:27:29.776410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b5897-3498-4aca-9372-b2e59fdb17b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:29.776620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:29.777552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b5897-3498-4aca-9372-b2e59fdb17b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.778123 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b5897-3498-4aca-9372-b2e59fdb17b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.778608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b5897-3498-4aca-9372-b2e59fdb17b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.779725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b5897-3498-4aca-9372-b2e59fdb17b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:29.781614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b5897-3498-4aca-9372-b2e59fdb17b4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:29.799074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 774/1547] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:29 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:29.804716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b5897-3498-4aca-9372-b2e59fdb17b4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:29.814584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 774/1548] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:29.821976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b5897-3498-4aca-9372-b2e59fdb17b4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:29.824441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:29.827954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfee036-33c5-4592-b6ed-43aed985f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:29.828972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee036-33c5-4592-b6ed-43aed985f826 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.829483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee036-33c5-4592-b6ed-43aed985f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.829987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee036-33c5-4592-b6ed-43aed985f826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.830951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfee036-33c5-4592-b6ed-43aed985f826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:29.832888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfee036-33c5-4592-b6ed-43aed985f826 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:29.862020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020292-cab2-445c-aef7-56472c7b79ae admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:29.870738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 775/1549] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:29 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:27:29.879772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfee036-33c5-4592-b6ed-43aed985f826 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:29.899589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfee036-33c5-4592-b6ed-43aed985f826 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:29.899831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a4197-3a09-4e74-a311-761a57f29c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:29.899831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4197-3a09-4e74-a311-761a57f29c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.899831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4197-3a09-4e74-a311-761a57f29c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.899831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4197-3a09-4e74-a311-761a57f29c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.900230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a4197-3a09-4e74-a311-761a57f29c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:29.901944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a4197-3a09-4e74-a311-761a57f29c02 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:29.912556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfa3fa-3cee-443e-a167-d7d6255b7028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:29.913806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfa3fa-3cee-443e-a167-d7d6255b7028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.914312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfa3fa-3cee-443e-a167-d7d6255b7028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.914788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfa3fa-3cee-443e-a167-d7d6255b7028 admin admin] PATH_INFO: `/v3/projects/c41904d347744ff795658fc78c439ebe/users/c8790c1f6da34ce3901a536ba76ae6b5/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.938764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfa3fa-3cee-443e-a167-d7d6255b7028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41904d347744ff795658fc78c439ebe, user_id=c8790c1f6da34ce3901a536ba76ae6b5, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:29.944476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING py.warnings [None req-adcfa3fa-3cee-443e-a167-d7d6255b7028 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:27:29.944476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 16:27:29.944476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: Jun 03 16:27:29.946954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfa3fa-3cee-443e-a167-d7d6255b7028 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:29.966832 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 776/1550] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:29 2022] PUT /identity/v3/projects/c41904d347744ff795658fc78c439ebe/users/c8790c1f6da34ce3901a536ba76ae6b5/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:27:29.972785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e54f1-442b-4acb-b863-34c8b7c61e2e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.973991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e54f1-442b-4acb-b863-34c8b7c61e2e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.974747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e54f1-442b-4acb-b863-34c8b7c61e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:29.982466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 775/1551] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:29 2022] POST /identity/v3/projects => generated 394 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:29.984122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f44f1-6c5f-4eda-a8b7-8838076ce661 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:29.984782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f44f1-6c5f-4eda-a8b7-8838076ce661 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:29.985067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f44f1-6c5f-4eda-a8b7-8838076ce661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.008272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3f3e54f1-442b-4acb-b863-34c8b7c61e2e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.009889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3f3e54f1-442b-4acb-b863-34c8b7c61e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.029839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ec1f44f1-6c5f-4eda-a8b7-8838076ce661 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.031097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ec1f44f1-6c5f-4eda-a8b7-8838076ce661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.112561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 777/1552] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.114076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e54f1-442b-4acb-b863-34c8b7c61e2e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.121940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:30.126763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e54f1-442b-4acb-b863-34c8b7c61e2e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.133066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bacd4-2fc6-48af-8cb6-9be8c67ee64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.134208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bacd4-2fc6-48af-8cb6-9be8c67ee64a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.134726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bacd4-2fc6-48af-8cb6-9be8c67ee64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.135228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bacd4-2fc6-48af-8cb6-9be8c67ee64a admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.136225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bacd4-2fc6-48af-8cb6-9be8c67ee64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.138520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bacd4-2fc6-48af-8cb6-9be8c67ee64a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.150063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 776/1553] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.152458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55a1cf-5f56-4afd-86c6-df7cbfca327c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.152458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55a1cf-5f56-4afd-86c6-df7cbfca327c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.152664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55a1cf-5f56-4afd-86c6-df7cbfca327c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.173720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 778/1554] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/users => generated 298 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:30.173720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e9e1-ba46-40b0-a7ef-50d4dacaebbf None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.173720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e9e1-ba46-40b0-a7ef-50d4dacaebbf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.173720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e9e1-ba46-40b0-a7ef-50d4dacaebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.177830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fb55a1cf-5f56-4afd-86c6-df7cbfca327c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.178529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fb55a1cf-5f56-4afd-86c6-df7cbfca327c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.190622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 777/1555] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.190622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc813dd-3d6d-4bb6-bec8-f569b990f886 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.190622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc813dd-3d6d-4bb6-bec8-f569b990f886 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.190622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc813dd-3d6d-4bb6-bec8-f569b990f886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.194831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3dc4e9e1-ba46-40b0-a7ef-50d4dacaebbf None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.196109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3dc4e9e1-ba46-40b0-a7ef-50d4dacaebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.207895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 779/1556] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.209598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0cc813dd-3d6d-4bb6-bec8-f569b990f886 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.210806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ec627-2eda-4e03-b8f1-6801fe650fd1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.210948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0cc813dd-3d6d-4bb6-bec8-f569b990f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.211344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ec627-2eda-4e03-b8f1-6801fe650fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.211884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ec627-2eda-4e03-b8f1-6801fe650fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.219304 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 778/1557] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.220808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7c58-ac7c-4bd2-8465-05c8d49106c7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.221447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7c58-ac7c-4bd2-8465-05c8d49106c7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.221736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7c58-ac7c-4bd2-8465-05c8d49106c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.240872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c04ec627-2eda-4e03-b8f1-6801fe650fd1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.241330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e8cb7c58-ac7c-4bd2-8465-05c8d49106c7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.242111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c04ec627-2eda-4e03-b8f1-6801fe650fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.242519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e8cb7c58-ac7c-4bd2-8465-05c8d49106c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.250268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 780/1558] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.250482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 779/1559] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.253288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb134c9-2cf9-4465-acb9-f690f387cb51 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.253288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb134c9-2cf9-4465-acb9-f690f387cb51 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.253632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7c58-ac7c-4bd2-8465-05c8d49106c7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.253772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb134c9-2cf9-4465-acb9-f690f387cb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.256525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e8cb7c58-ac7c-4bd2-8465-05c8d49106c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.273450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6fb134c9-2cf9-4465-acb9-f690f387cb51 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.274681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6fb134c9-2cf9-4465-acb9-f690f387cb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.282637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 781/1560] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.283509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb134c9-2cf9-4465-acb9-f690f387cb51 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.300237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb134c9-2cf9-4465-acb9-f690f387cb51 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.302666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:30.305227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7701ae-1191-4431-8b74-9d71eb4f86c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.305907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7701ae-1191-4431-8b74-9d71eb4f86c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.306189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7701ae-1191-4431-8b74-9d71eb4f86c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.306539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7701ae-1191-4431-8b74-9d71eb4f86c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.307355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7701ae-1191-4431-8b74-9d71eb4f86c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.309031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7701ae-1191-4431-8b74-9d71eb4f86c7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.324339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 782/1561] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:30 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:30.324339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40c075-9cab-40fb-9c4b-49481c19bb38 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.324339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40c075-9cab-40fb-9c4b-49481c19bb38 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.324339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40c075-9cab-40fb-9c4b-49481c19bb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.331222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7c58-ac7c-4bd2-8465-05c8d49106c7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.335480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e9df4-7986-4282-8d99-8ea4af4e12af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.336225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e9df4-7986-4282-8d99-8ea4af4e12af service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.336507 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e9df4-7986-4282-8d99-8ea4af4e12af service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.336789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e9df4-7986-4282-8d99-8ea4af4e12af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.341150 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9a40c075-9cab-40fb-9c4b-49481c19bb38 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.342357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9a40c075-9cab-40fb-9c4b-49481c19bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.346546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e9df4-7986-4282-8d99-8ea4af4e12af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.348731 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e9df4-7986-4282-8d99-8ea4af4e12af service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.351212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 783/1562] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.352540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b09db0-fdb8-4b48-9434-0878c95f5789 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.352983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b09db0-fdb8-4b48-9434-0878c95f5789 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.353140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b09db0-fdb8-4b48-9434-0878c95f5789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.360493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 780/1563] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:30.362364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3897-f890-45f9-b40c-65dcec8591a4 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.362364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3897-f890-45f9-b40c-65dcec8591a4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.362364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3897-f890-45f9-b40c-65dcec8591a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.374911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a1b09db0-fdb8-4b48-9434-0878c95f5789 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.376625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a1b09db0-fdb8-4b48-9434-0878c95f5789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.385389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 784/1564] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.386714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565e4c4-ff40-4e38-94c0-2e20ebf17ada None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.387092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565e4c4-ff40-4e38-94c0-2e20ebf17ada None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.387381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565e4c4-ff40-4e38-94c0-2e20ebf17ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.396262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b24a3897-f890-45f9-b40c-65dcec8591a4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.398513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b24a3897-f890-45f9-b40c-65dcec8591a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.413845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2565e4c4-ff40-4e38-94c0-2e20ebf17ada None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.415143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 781/1565] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.416069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2565e4c4-ff40-4e38-94c0-2e20ebf17ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.416313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3897-f890-45f9-b40c-65dcec8591a4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.426095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 785/1566] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.428260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051798e2-4550-4e2a-bf8a-172486f99da0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.428781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051798e2-4550-4e2a-bf8a-172486f99da0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.429128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051798e2-4550-4e2a-bf8a-172486f99da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.437660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3897-f890-45f9-b40c-65dcec8591a4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.445225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c32e38-4e37-4f7f-80ad-0e43d166959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.446115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c32e38-4e37-4f7f-80ad-0e43d166959b admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.446533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c32e38-4e37-4f7f-80ad-0e43d166959b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.447075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c32e38-4e37-4f7f-80ad-0e43d166959b admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.448137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c32e38-4e37-4f7f-80ad-0e43d166959b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:30.448608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c32e38-4e37-4f7f-80ad-0e43d166959b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.450356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c32e38-4e37-4f7f-80ad-0e43d166959b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.452653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-051798e2-4550-4e2a-bf8a-172486f99da0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:30.453993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-051798e2-4550-4e2a-bf8a-172486f99da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:30.465015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 786/1567] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:30.466110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051798e2-4550-4e2a-bf8a-172486f99da0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.467713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 782/1568] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:30.468907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c32e38-4e37-4f7f-80ad-0e43d166959b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.482333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c32e38-4e37-4f7f-80ad-0e43d166959b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.487893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051798e2-4550-4e2a-bf8a-172486f99da0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.490722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f903ae6-48ab-4556-8db1-fa8fdbcf9195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.491900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f903ae6-48ab-4556-8db1-fa8fdbcf9195 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.492213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f903ae6-48ab-4556-8db1-fa8fdbcf9195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.492478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f903ae6-48ab-4556-8db1-fa8fdbcf9195 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.493264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f903ae6-48ab-4556-8db1-fa8fdbcf9195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:30.493677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f903ae6-48ab-4556-8db1-fa8fdbcf9195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.495308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f903ae6-48ab-4556-8db1-fa8fdbcf9195 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.497606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb9e7-83e6-45de-9fa1-14c56d3d6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.498548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb9e7-83e6-45de-9fa1-14c56d3d6330 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.498690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb9e7-83e6-45de-9fa1-14c56d3d6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.498897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb9e7-83e6-45de-9fa1-14c56d3d6330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.500256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb9e7-83e6-45de-9fa1-14c56d3d6330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.501599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb9e7-83e6-45de-9fa1-14c56d3d6330 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.520536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 783/1569] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:30.520536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f903ae6-48ab-4556-8db1-fa8fdbcf9195 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.520982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 787/1570] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:30 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:30.520982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb9e7-83e6-45de-9fa1-14c56d3d6330 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.530713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f903ae6-48ab-4556-8db1-fa8fdbcf9195 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.534584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb9e7-83e6-45de-9fa1-14c56d3d6330 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.537088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada5bc3-0e2f-4b00-a2ef-65b85bcad9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.538967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada5bc3-0e2f-4b00-a2ef-65b85bcad9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.539446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada5bc3-0e2f-4b00-a2ef-65b85bcad9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.540656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae1d7b-7ece-4444-8092-fb4c0096e968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.540833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada5bc3-0e2f-4b00-a2ef-65b85bcad9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.540935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae1d7b-7ece-4444-8092-fb4c0096e968 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.540935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae1d7b-7ece-4444-8092-fb4c0096e968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.541357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae1d7b-7ece-4444-8092-fb4c0096e968 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.541612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada5bc3-0e2f-4b00-a2ef-65b85bcad9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:30.542136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada5bc3-0e2f-4b00-a2ef-65b85bcad9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.542288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae1d7b-7ece-4444-8092-fb4c0096e968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:30.542436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae1d7b-7ece-4444-8092-fb4c0096e968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.544014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada5bc3-0e2f-4b00-a2ef-65b85bcad9e7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.544277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae1d7b-7ece-4444-8092-fb4c0096e968 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.560385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 788/1571] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:30.561681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae1d7b-7ece-4444-8092-fb4c0096e968 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.563311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 784/1572] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:30.564240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada5bc3-0e2f-4b00-a2ef-65b85bcad9e7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.580704 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada5bc3-0e2f-4b00-a2ef-65b85bcad9e7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.585053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae1d7b-7ece-4444-8092-fb4c0096e968 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.593494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09a50a-0568-4af2-b54a-4a3196eaff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.594325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09a50a-0568-4af2-b54a-4a3196eaff3e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.594989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09a50a-0568-4af2-b54a-4a3196eaff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.595846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09a50a-0568-4af2-b54a-4a3196eaff3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.596562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab0cf5-9918-4043-b916-68857947316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.597144 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab0cf5-9918-4043-b916-68857947316c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.597252 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09a50a-0568-4af2-b54a-4a3196eaff3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:30.597486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab0cf5-9918-4043-b916-68857947316c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.597600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09a50a-0568-4af2-b54a-4a3196eaff3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.597716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab0cf5-9918-4043-b916-68857947316c admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.598548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab0cf5-9918-4043-b916-68857947316c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:30.598860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab0cf5-9918-4043-b916-68857947316c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.599206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09a50a-0568-4af2-b54a-4a3196eaff3e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.600537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab0cf5-9918-4043-b916-68857947316c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.620804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 789/1573] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:30.620804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab0cf5-9918-4043-b916-68857947316c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.627027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab0cf5-9918-4043-b916-68857947316c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.631678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 785/1574] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:30.632915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09a50a-0568-4af2-b54a-4a3196eaff3e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.637456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb912be-3b15-4e11-bab3-2e155876a5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.638485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb912be-3b15-4e11-bab3-2e155876a5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.638771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb912be-3b15-4e11-bab3-2e155876a5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.639050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb912be-3b15-4e11-bab3-2e155876a5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.639970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb912be-3b15-4e11-bab3-2e155876a5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.642623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb912be-3b15-4e11-bab3-2e155876a5b3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.644266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09a50a-0568-4af2-b54a-4a3196eaff3e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.650748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da720d6-bbe2-4fe3-968f-076097970bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.652975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da720d6-bbe2-4fe3-968f-076097970bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.652975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da720d6-bbe2-4fe3-968f-076097970bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.652975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da720d6-bbe2-4fe3-968f-076097970bd5 admin admin] PATH_INFO: `/v3/projects/232f1604330b4672982783db3a59555b/users/0e073346668d44e49bd8b94737a6dafd/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.671102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da720d6-bbe2-4fe3-968f-076097970bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232f1604330b4672982783db3a59555b, user_id=0e073346668d44e49bd8b94737a6dafd, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.673982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da720d6-bbe2-4fe3-968f-076097970bd5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.676827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 790/1575] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/projects => generated 386 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:30.677911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb912be-3b15-4e11-bab3-2e155876a5b3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.695349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 786/1576] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:30 2022] PUT /identity/v3/projects/232f1604330b4672982783db3a59555b/users/0e073346668d44e49bd8b94737a6dafd/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:30.695349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da720d6-bbe2-4fe3-968f-076097970bd5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.789945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da720d6-bbe2-4fe3-968f-076097970bd5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.795074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb912be-3b15-4e11-bab3-2e155876a5b3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.795253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f88056-6761-4c5c-89a8-863aa73de0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.796035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f88056-6761-4c5c-89a8-863aa73de0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.796468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f88056-6761-4c5c-89a8-863aa73de0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.796883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f88056-6761-4c5c-89a8-863aa73de0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.798084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f88056-6761-4c5c-89a8-863aa73de0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.800437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f88056-6761-4c5c-89a8-863aa73de0c5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.803717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29af76c-60fb-47b2-a2ea-8a4e944a1eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.806572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29af76c-60fb-47b2-a2ea-8a4e944a1eca admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.807079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29af76c-60fb-47b2-a2ea-8a4e944a1eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.807629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29af76c-60fb-47b2-a2ea-8a4e944a1eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.808952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29af76c-60fb-47b2-a2ea-8a4e944a1eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.812061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29af76c-60fb-47b2-a2ea-8a4e944a1eca admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.840644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 787/1577] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/projects => generated 376 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:30.840644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f88056-6761-4c5c-89a8-863aa73de0c5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.852174 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 791/1578] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/projects => generated 384 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:30.852951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29af76c-60fb-47b2-a2ea-8a4e944a1eca admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.876788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:30.898836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:30.936845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f88056-6761-4c5c-89a8-863aa73de0c5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.944418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79064c92-a16a-479b-a35a-e6b62dcf33d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.945182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79064c92-a16a-479b-a35a-e6b62dcf33d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.945626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79064c92-a16a-479b-a35a-e6b62dcf33d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.945906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79064c92-a16a-479b-a35a-e6b62dcf33d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.946768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79064c92-a16a-479b-a35a-e6b62dcf33d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.947737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29af76c-60fb-47b2-a2ea-8a4e944a1eca admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:30.949193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79064c92-a16a-479b-a35a-e6b62dcf33d3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.954489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f79787-b837-42f9-ab46-0da4196e60c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:30.955888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f79787-b837-42f9-ab46-0da4196e60c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:30.956355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f79787-b837-42f9-ab46-0da4196e60c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:30.956842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f79787-b837-42f9-ab46-0da4196e60c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:30.958286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f79787-b837-42f9-ab46-0da4196e60c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:30.961244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f79787-b837-42f9-ab46-0da4196e60c9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:30.985581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 788/1579] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/projects => generated 374 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:30.986894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79064c92-a16a-479b-a35a-e6b62dcf33d3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:30.999385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 792/1580] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/projects => generated 384 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:31.003486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f79787-b837-42f9-ab46-0da4196e60c9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.063758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79064c92-a16a-479b-a35a-e6b62dcf33d3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.090720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f79787-b837-42f9-ab46-0da4196e60c9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.097544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcc770-062f-4d18-ac93-aff44f14209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.098815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc770-062f-4d18-ac93-aff44f14209b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.099106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc770-062f-4d18-ac93-aff44f14209b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.099387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc770-062f-4d18-ac93-aff44f14209b admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.100615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcc770-062f-4d18-ac93-aff44f14209b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.103183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcc770-062f-4d18-ac93-aff44f14209b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.130831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 793/1581] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:31.131529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe59465-f1a5-4098-8b6d-e6dfad1ff0fc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.131839 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe59465-f1a5-4098-8b6d-e6dfad1ff0fc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.132117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe59465-f1a5-4098-8b6d-e6dfad1ff0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.140211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8979-e0eb-4297-9c25-d9af9c2720cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.141039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8979-e0eb-4297-9c25-d9af9c2720cc admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.142657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8979-e0eb-4297-9c25-d9af9c2720cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.143011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e8979-e0eb-4297-9c25-d9af9c2720cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.143830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e8979-e0eb-4297-9c25-d9af9c2720cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.146523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e8979-e0eb-4297-9c25-d9af9c2720cc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.152474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1fe59465-f1a5-4098-8b6d-e6dfad1ff0fc None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:31.154317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1fe59465-f1a5-4098-8b6d-e6dfad1ff0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:31.173519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 794/1582] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:31.175453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe59465-f1a5-4098-8b6d-e6dfad1ff0fc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.186257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe59465-f1a5-4098-8b6d-e6dfad1ff0fc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.191280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ae237-6652-409e-98a3-1f4f0cb577ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.192550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae237-6652-409e-98a3-1f4f0cb577ee admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.192826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae237-6652-409e-98a3-1f4f0cb577ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.193095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ae237-6652-409e-98a3-1f4f0cb577ee admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.193791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ae237-6652-409e-98a3-1f4f0cb577ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.195994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ae237-6652-409e-98a3-1f4f0cb577ee admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.209546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 789/1583] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:30 2022] POST /identity/v3/projects => generated 374 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:31.210658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8979-e0eb-4297-9c25-d9af9c2720cc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.221949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 795/1584] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:31 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:31.222688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ae237-6652-409e-98a3-1f4f0cb577ee admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.233683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ae237-6652-409e-98a3-1f4f0cb577ee admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.281357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:31.289107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e8979-e0eb-4297-9c25-d9af9c2720cc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.296727 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5a01c-50ca-491b-bfa7-cd5d4fd44326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.297832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5a01c-50ca-491b-bfa7-cd5d4fd44326 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.298119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5a01c-50ca-491b-bfa7-cd5d4fd44326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.298395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5a01c-50ca-491b-bfa7-cd5d4fd44326 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.299091 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5a01c-50ca-491b-bfa7-cd5d4fd44326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.300137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WARNING py.warnings [None req-eff5a01c-50ca-491b-bfa7-cd5d4fd44326 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:27:31.300137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 16:27:31.300137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: Jun 03 16:27:31.301381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5a01c-50ca-491b-bfa7-cd5d4fd44326 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.303162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ba1ab-dce2-4102-96bf-d29e25859efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.303865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ba1ab-dce2-4102-96bf-d29e25859efb admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.304515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ba1ab-dce2-4102-96bf-d29e25859efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.304515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ba1ab-dce2-4102-96bf-d29e25859efb admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.305268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ba1ab-dce2-4102-96bf-d29e25859efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.307262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ba1ab-dce2-4102-96bf-d29e25859efb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.316242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:31.326383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 790/1585] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:31 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:31.327315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5a01c-50ca-491b-bfa7-cd5d4fd44326 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.331968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 796/1586] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:31 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:31.334109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ba1ab-dce2-4102-96bf-d29e25859efb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.342541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5a01c-50ca-491b-bfa7-cd5d4fd44326 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.344781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ba1ab-dce2-4102-96bf-d29e25859efb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.347472 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ee8b7-5364-455c-8440-a028a35344f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.348314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ee8b7-5364-455c-8440-a028a35344f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.348641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ee8b7-5364-455c-8440-a028a35344f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.348932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ee8b7-5364-455c-8440-a028a35344f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.349633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ee8b7-5364-455c-8440-a028a35344f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.351751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ee8b7-5364-455c-8440-a028a35344f9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.352619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c2181-082a-46ab-a097-d9ed0e43e714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.353575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c2181-082a-46ab-a097-d9ed0e43e714 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.354019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c2181-082a-46ab-a097-d9ed0e43e714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.354451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c2181-082a-46ab-a097-d9ed0e43e714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.355394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c2181-082a-46ab-a097-d9ed0e43e714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.357410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c2181-082a-46ab-a097-d9ed0e43e714 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.368490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 797/1587] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.369849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277933cf-9f04-41a1-9294-0b49035803cf None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.370075 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277933cf-9f04-41a1-9294-0b49035803cf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.370351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277933cf-9f04-41a1-9294-0b49035803cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.377184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 791/1588] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:31 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:31.378122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ee8b7-5364-455c-8440-a028a35344f9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.400986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-277933cf-9f04-41a1-9294-0b49035803cf None None] MFA Rules not processed for user `c8790c1f6da34ce3901a536ba76ae6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:31.402200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-277933cf-9f04-41a1-9294-0b49035803cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:31.434867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ee8b7-5364-455c-8440-a028a35344f9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.438597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976226f-9d4f-46a6-be2e-dfbfa321d8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.439242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976226f-9d4f-46a6-be2e-dfbfa321d8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.439529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976226f-9d4f-46a6-be2e-dfbfa321d8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.439842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976226f-9d4f-46a6-be2e-dfbfa321d8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.450057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976226f-9d4f-46a6-be2e-dfbfa321d8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.451434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976226f-9d4f-46a6-be2e-dfbfa321d8c6 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.462366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 792/1589] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:31.463680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976226f-9d4f-46a6-be2e-dfbfa321d8c6 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.469018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 798/1590] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:31.469852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277933cf-9f04-41a1-9294-0b49035803cf None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.474588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976226f-9d4f-46a6-be2e-dfbfa321d8c6 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.481534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438a2df-fc1a-476d-a7ab-19896a2f0a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.481879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277933cf-9f04-41a1-9294-0b49035803cf None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.482781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438a2df-fc1a-476d-a7ab-19896a2f0a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.483336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438a2df-fc1a-476d-a7ab-19896a2f0a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.484145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438a2df-fc1a-476d-a7ab-19896a2f0a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.485288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438a2df-fc1a-476d-a7ab-19896a2f0a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.487969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438a2df-fc1a-476d-a7ab-19896a2f0a78 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.488319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a305-0073-4c8d-940f-8ddce8a64203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.489274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a305-0073-4c8d-940f-8ddce8a64203 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.489643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a305-0073-4c8d-940f-8ddce8a64203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.490152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a305-0073-4c8d-940f-8ddce8a64203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.490846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62a305-0073-4c8d-940f-8ddce8a64203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.492584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62a305-0073-4c8d-940f-8ddce8a64203 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.503575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 799/1591] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.505155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a305-0073-4c8d-940f-8ddce8a64203 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.515432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a305-0073-4c8d-940f-8ddce8a64203 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.516232 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 793/1592] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:31 2022] POST /identity/v3/users => generated 288 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:31.516976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438a2df-fc1a-476d-a7ab-19896a2f0a78 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.524743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dace02e-9b9c-489f-8de1-f76585423a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.525181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dace02e-9b9c-489f-8de1-f76585423a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.525181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dace02e-9b9c-489f-8de1-f76585423a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.525491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dace02e-9b9c-489f-8de1-f76585423a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.526193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dace02e-9b9c-489f-8de1-f76585423a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.527943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dace02e-9b9c-489f-8de1-f76585423a95 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.531061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438a2df-fc1a-476d-a7ab-19896a2f0a78 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.540253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 800/1593] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.541302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dace02e-9b9c-489f-8de1-f76585423a95 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.548760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe3483-338a-4505-b107-deca8f27e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.549528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe3483-338a-4505-b107-deca8f27e1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.549815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe3483-338a-4505-b107-deca8f27e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.550126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe3483-338a-4505-b107-deca8f27e1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.551509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe3483-338a-4505-b107-deca8f27e1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.553330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe3483-338a-4505-b107-deca8f27e1ca admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.556753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dace02e-9b9c-489f-8de1-f76585423a95 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.563131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e7b07-7e56-44cf-a041-3529b7636599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.564113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e7b07-7e56-44cf-a041-3529b7636599 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.564501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e7b07-7e56-44cf-a041-3529b7636599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.564881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e7b07-7e56-44cf-a041-3529b7636599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.568899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 794/1594] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.569102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e7b07-7e56-44cf-a041-3529b7636599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.569208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe3483-338a-4505-b107-deca8f27e1ca admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.569312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e7b07-7e56-44cf-a041-3529b7636599 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.580579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe3483-338a-4505-b107-deca8f27e1ca admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.585739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 801/1595] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.588120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a1466-705a-48aa-aa7c-c712dbd6285f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.588412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a1466-705a-48aa-aa7c-c712dbd6285f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.590028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a1466-705a-48aa-aa7c-c712dbd6285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.590840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99ae5a-3e10-418b-84b7-54f6dd251fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.591840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99ae5a-3e10-418b-84b7-54f6dd251fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.592129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99ae5a-3e10-418b-84b7-54f6dd251fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.592409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99ae5a-3e10-418b-84b7-54f6dd251fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.593963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99ae5a-3e10-418b-84b7-54f6dd251fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.599621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99ae5a-3e10-418b-84b7-54f6dd251fb2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.613928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 795/1596] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.613928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99ae5a-3e10-418b-84b7-54f6dd251fb2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.619533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f05a1466-705a-48aa-aa7c-c712dbd6285f None None] MFA Rules not processed for user `c8790c1f6da34ce3901a536ba76ae6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:31.621080 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f05a1466-705a-48aa-aa7c-c712dbd6285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:31.623390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99ae5a-3e10-418b-84b7-54f6dd251fb2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.628612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b5c80-8bff-4998-b21b-c30a363a14c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.629945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 802/1597] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:31.630088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b5c80-8bff-4998-b21b-c30a363a14c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.630381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b5c80-8bff-4998-b21b-c30a363a14c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.630668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b5c80-8bff-4998-b21b-c30a363a14c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.631012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a1466-705a-48aa-aa7c-c712dbd6285f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.632964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b5c80-8bff-4998-b21b-c30a363a14c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.634599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b5c80-8bff-4998-b21b-c30a363a14c5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.643210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a1466-705a-48aa-aa7c-c712dbd6285f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.651018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca909-1b1e-42bb-a96d-c7b9c2fe8a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.651928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca909-1b1e-42bb-a96d-c7b9c2fe8a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.652357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca909-1b1e-42bb-a96d-c7b9c2fe8a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.652922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 796/1598] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.653810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b5c80-8bff-4998-b21b-c30a363a14c5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.655940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca909-1b1e-42bb-a96d-c7b9c2fe8a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.657105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca909-1b1e-42bb-a96d-c7b9c2fe8a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.659510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca909-1b1e-42bb-a96d-c7b9c2fe8a80 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.667617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b5c80-8bff-4998-b21b-c30a363a14c5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.674388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 803/1599] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.674587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828e78a-852a-4d96-8704-d0f6eb776085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.675380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828e78a-852a-4d96-8704-d0f6eb776085 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.675707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828e78a-852a-4d96-8704-d0f6eb776085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.676673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828e78a-852a-4d96-8704-d0f6eb776085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.677345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca909-1b1e-42bb-a96d-c7b9c2fe8a80 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.677991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828e78a-852a-4d96-8704-d0f6eb776085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.680182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828e78a-852a-4d96-8704-d0f6eb776085 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.689314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca909-1b1e-42bb-a96d-c7b9c2fe8a80 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.692768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 797/1600] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.693484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828e78a-852a-4d96-8704-d0f6eb776085 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.697950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c8ee-16da-47f6-84de-5159087aaeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.699338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c8ee-16da-47f6-84de-5159087aaeaf admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.700153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c8ee-16da-47f6-84de-5159087aaeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.700391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c8ee-16da-47f6-84de-5159087aaeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.701734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127c8ee-16da-47f6-84de-5159087aaeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.703350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127c8ee-16da-47f6-84de-5159087aaeaf admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.717147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828e78a-852a-4d96-8704-d0f6eb776085 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.719205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 804/1601] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.723838 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c8ee-16da-47f6-84de-5159087aaeaf admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.726369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcaded-85cd-455a-8aea-d1e279f6d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.727466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcaded-85cd-455a-8aea-d1e279f6d48c admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.727849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcaded-85cd-455a-8aea-d1e279f6d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.728242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcaded-85cd-455a-8aea-d1e279f6d48c admin admin] PATH_INFO: `/v3/projects/c9e5c29c6ed74d94b94555d57e1905db/users/bdf91133123a468fbb8297092fd22484/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.736787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c8ee-16da-47f6-84de-5159087aaeaf admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.742746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36e147-0b9a-4ea6-9f09-2aa5e3172492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.743943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36e147-0b9a-4ea6-9f09-2aa5e3172492 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.744382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36e147-0b9a-4ea6-9f09-2aa5e3172492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.744840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36e147-0b9a-4ea6-9f09-2aa5e3172492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.745825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36e147-0b9a-4ea6-9f09-2aa5e3172492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.747934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36e147-0b9a-4ea6-9f09-2aa5e3172492 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.761994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 805/1602] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.763371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36e147-0b9a-4ea6-9f09-2aa5e3172492 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.763965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcaded-85cd-455a-8aea-d1e279f6d48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e5c29c6ed74d94b94555d57e1905db, user_id=bdf91133123a468fbb8297092fd22484, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.767882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcaded-85cd-455a-8aea-d1e279f6d48c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.782285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36e147-0b9a-4ea6-9f09-2aa5e3172492 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.792873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 798/1603] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:31 2022] PUT /identity/v3/projects/c9e5c29c6ed74d94b94555d57e1905db/users/bdf91133123a468fbb8297092fd22484/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:31.792873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1734-f116-45c0-b429-f31991057bcd None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.792873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1734-f116-45c0-b429-f31991057bcd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.792873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1734-f116-45c0-b429-f31991057bcd None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.795729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 799/1604] 10.222.0.112 () {54 vars in 966 bytes} [Fri Jun 3 16:27:31 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:27:31.796644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1734-f116-45c0-b429-f31991057bcd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.856410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:31.867973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddf537-9971-4f8f-a597-203bcce034c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.868873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddf537-9971-4f8f-a597-203bcce034c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.869153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddf537-9971-4f8f-a597-203bcce034c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.869427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddf537-9971-4f8f-a597-203bcce034c8 admin admin] PATH_INFO: `/v3/projects/a8dede52b25a418ea3372f9dd70bbff0/users/b46af0c538244e1c9d2fe55470841d15/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.872847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:31.883459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1734-f116-45c0-b429-f31991057bcd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:31.890041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddf537-9971-4f8f-a597-203bcce034c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dede52b25a418ea3372f9dd70bbff0, user_id=b46af0c538244e1c9d2fe55470841d15, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.891414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b847f91-ef14-40b6-aa97-030eba249f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:31.892323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b847f91-ef14-40b6-aa97-030eba249f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:31.892707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b847f91-ef14-40b6-aa97-030eba249f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:31.893108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddf537-9971-4f8f-a597-203bcce034c8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.893238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b847f91-ef14-40b6-aa97-030eba249f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:31.894180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b847f91-ef14-40b6-aa97-030eba249f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:31.897074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b847f91-ef14-40b6-aa97-030eba249f8e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:31.913358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 800/1605] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:31 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:31.913358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b847f91-ef14-40b6-aa97-030eba249f8e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.915602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 806/1606] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:31 2022] PUT /identity/v3/projects/a8dede52b25a418ea3372f9dd70bbff0/users/b46af0c538244e1c9d2fe55470841d15/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:31.916663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddf537-9971-4f8f-a597-203bcce034c8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:31.924332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b847f91-ef14-40b6-aa97-030eba249f8e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:32.000162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87570d3e-3df8-4762-b742-934953d99572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:32.001519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87570d3e-3df8-4762-b742-934953d99572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.001952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87570d3e-3df8-4762-b742-934953d99572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.003389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87570d3e-3df8-4762-b742-934953d99572 admin admin] PATH_INFO: `/v3/projects/adb5effed48748a9a52987c2a02a572b/users/92ace4f3dad3447f90ccb5abdb93f2fb/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.008569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddf537-9971-4f8f-a597-203bcce034c8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:32.013617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef4f9-cb74-4d8c-832a-fc3431e1987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:32.014516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef4f9-cb74-4d8c-832a-fc3431e1987b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.015365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef4f9-cb74-4d8c-832a-fc3431e1987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.015365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef4f9-cb74-4d8c-832a-fc3431e1987b admin admin] PATH_INFO: `/v3/projects/67e436bd400944c097c2fbdd51c7f8b4/users/32afd658bb6e4211a6f14c94fda8ab5f/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.023933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87570d3e-3df8-4762-b742-934953d99572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb5effed48748a9a52987c2a02a572b, user_id=92ace4f3dad3447f90ccb5abdb93f2fb, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:32.027128 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87570d3e-3df8-4762-b742-934953d99572 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:32.032767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef4f9-cb74-4d8c-832a-fc3431e1987b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e436bd400944c097c2fbdd51c7f8b4, user_id=32afd658bb6e4211a6f14c94fda8ab5f, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:32.035989 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef4f9-cb74-4d8c-832a-fc3431e1987b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:32.043041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 801/1607] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:31 2022] PUT /identity/v3/projects/adb5effed48748a9a52987c2a02a572b/users/92ace4f3dad3447f90ccb5abdb93f2fb/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:32.052156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 807/1608] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:31 2022] PUT /identity/v3/projects/67e436bd400944c097c2fbdd51c7f8b4/users/32afd658bb6e4211a6f14c94fda8ab5f/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:32.053965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1424647-837f-4832-8cb3-bf77b1cd8a75 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.054398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1424647-837f-4832-8cb3-bf77b1cd8a75 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.054854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1424647-837f-4832-8cb3-bf77b1cd8a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.055482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87570d3e-3df8-4762-b742-934953d99572 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:32.077271 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b1424647-837f-4832-8cb3-bf77b1cd8a75 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:32.078744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b1424647-837f-4832-8cb3-bf77b1cd8a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:32.137224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87570d3e-3df8-4762-b742-934953d99572 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:32.146919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 808/1609] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:32.148768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b318c-fdf4-4f04-a081-9e5d3e10461f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.149049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b318c-fdf4-4f04-a081-9e5d3e10461f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.149334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b318c-fdf4-4f04-a081-9e5d3e10461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.170378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-629b318c-fdf4-4f04-a081-9e5d3e10461f None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:32.171802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-629b318c-fdf4-4f04-a081-9e5d3e10461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:32.205778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed3497-e1e3-4f2e-b696-0443934c691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:32.206988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3497-e1e3-4f2e-b696-0443934c691f admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.207602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3497-e1e3-4f2e-b696-0443934c691f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.208025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3497-e1e3-4f2e-b696-0443934c691f admin admin] PATH_INFO: `/v3/projects/b0fa2c1a7b3547df9a7f0e04e1878e43/users/7efe80acf0684cd189ccf50e27f3acca/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.225832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed3497-e1e3-4f2e-b696-0443934c691f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0fa2c1a7b3547df9a7f0e04e1878e43, user_id=7efe80acf0684cd189ccf50e27f3acca, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:32.228655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed3497-e1e3-4f2e-b696-0443934c691f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:32.231969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:32.240141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:32.250070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 802/1610] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:32 2022] PUT /identity/v3/projects/b0fa2c1a7b3547df9a7f0e04e1878e43/users/7efe80acf0684cd189ccf50e27f3acca/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:32.250933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed3497-e1e3-4f2e-b696-0443934c691f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:32.263074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 809/1611] 10.222.0.112 () {58 vars in 1063 bytes} [Fri Jun 3 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:32.264512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2b22-08fe-4efa-a909-8aba4f94f0c3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.264806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2b22-08fe-4efa-a909-8aba4f94f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.265084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2b22-08fe-4efa-a909-8aba4f94f0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.288452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-092c2b22-08fe-4efa-a909-8aba4f94f0c3 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:32.290022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-092c2b22-08fe-4efa-a909-8aba4f94f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:32.345691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed3497-e1e3-4f2e-b696-0443934c691f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:32.352300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd45f62-0a2f-4c81-b71d-1a1015877f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:32.353522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd45f62-0a2f-4c81-b71d-1a1015877f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.353659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd45f62-0a2f-4c81-b71d-1a1015877f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.354034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd45f62-0a2f-4c81-b71d-1a1015877f19 admin admin] PATH_INFO: `/v3/projects/ac03899b05494e3589abc750cf89c480/users/ca8e5ae7c2144a72aa57b7d2ddd9b442/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.373388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd45f62-0a2f-4c81-b71d-1a1015877f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac03899b05494e3589abc750cf89c480, user_id=ca8e5ae7c2144a72aa57b7d2ddd9b442, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:32.373987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 810/1612] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:32.375436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c6ed0-9ad3-4b73-8ed4-852063a5a8be None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.376348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c6ed0-9ad3-4b73-8ed4-852063a5a8be None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.379994 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd45f62-0a2f-4c81-b71d-1a1015877f19 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:32.380395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c6ed0-9ad3-4b73-8ed4-852063a5a8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.395584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 803/1613] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:32 2022] PUT /identity/v3/projects/ac03899b05494e3589abc750cf89c480/users/ca8e5ae7c2144a72aa57b7d2ddd9b442/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:32.406480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2beab-7eb9-4ace-8a64-1ee387bb32b3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.406480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2beab-7eb9-4ace-8a64-1ee387bb32b3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.406480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2beab-7eb9-4ace-8a64-1ee387bb32b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.433588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-604c6ed0-9ad3-4b73-8ed4-852063a5a8be None None] MFA Rules not processed for user `92ace4f3dad3447f90ccb5abdb93f2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:32.435176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-604c6ed0-9ad3-4b73-8ed4-852063a5a8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:32.445756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-05f2beab-7eb9-4ace-8a64-1ee387bb32b3 None None] MFA Rules not processed for user `32afd658bb6e4211a6f14c94fda8ab5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:32.448329 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-05f2beab-7eb9-4ace-8a64-1ee387bb32b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:32.526637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 804/1614] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:32.527876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2beab-7eb9-4ace-8a64-1ee387bb32b3 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:32.530991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 811/1615] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:32.532534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979202-3ba1-48b6-9f98-390737adfa2c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.532828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979202-3ba1-48b6-9f98-390737adfa2c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.533117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00979202-3ba1-48b6-9f98-390737adfa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.562414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-00979202-3ba1-48b6-9f98-390737adfa2c None None] MFA Rules not processed for user `7efe80acf0684cd189ccf50e27f3acca`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:32.563799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-00979202-3ba1-48b6-9f98-390737adfa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:32.630622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2beab-7eb9-4ace-8a64-1ee387bb32b3 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:32.639322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3765e2-7db1-4353-83a0-b431042bbe99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:32.640089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3765e2-7db1-4353-83a0-b431042bbe99 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.640374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3765e2-7db1-4353-83a0-b431042bbe99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.640647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3765e2-7db1-4353-83a0-b431042bbe99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.665487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:32.696127 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 812/1616] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:32.697665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00979202-3ba1-48b6-9f98-390737adfa2c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:32.730991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3765e2-7db1-4353-83a0-b431042bbe99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:32.732362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:32.733056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3765e2-7db1-4353-83a0-b431042bbe99 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:32.747336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 805/1617] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:32.748341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3765e2-7db1-4353-83a0-b431042bbe99 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:32.760525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3765e2-7db1-4353-83a0-b431042bbe99 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:32.765181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35323913-f200-45df-9321-1a4db64b4a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:32.765891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35323913-f200-45df-9321-1a4db64b4a34 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.766323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35323913-f200-45df-9321-1a4db64b4a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.767013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35323913-f200-45df-9321-1a4db64b4a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.780180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35323913-f200-45df-9321-1a4db64b4a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:32.781997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35323913-f200-45df-9321-1a4db64b4a34 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:32.794810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 806/1618] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:32.797461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112511f3-4da3-46de-ba0c-15744d4a39a1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.798235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112511f3-4da3-46de-ba0c-15744d4a39a1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.798735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112511f3-4da3-46de-ba0c-15744d4a39a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:32.841348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00979202-3ba1-48b6-9f98-390737adfa2c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:32.850604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-112511f3-4da3-46de-ba0c-15744d4a39a1 None None] MFA Rules not processed for user `ca8e5ae7c2144a72aa57b7d2ddd9b442`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:32.854475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-112511f3-4da3-46de-ba0c-15744d4a39a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:32.857363 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb796df4-6306-482f-b875-8be964eee01a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:32.859081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb796df4-6306-482f-b875-8be964eee01a service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:32.867670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb796df4-6306-482f-b875-8be964eee01a service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:32.868146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb796df4-6306-482f-b875-8be964eee01a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.048333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb796df4-6306-482f-b875-8be964eee01a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:33.050089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb796df4-6306-482f-b875-8be964eee01a service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:33.074311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 813/1619] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:33.078896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6a26f-b6a8-4c48-a7f7-c86316c7ea51 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.079903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6a26f-b6a8-4c48-a7f7-c86316c7ea51 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.080285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6a26f-b6a8-4c48-a7f7-c86316c7ea51 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.086033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 814/1620] 10.222.0.112 () {54 vars in 966 bytes} [Fri Jun 3 16:27:33 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:27:33.088106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6a26f-b6a8-4c48-a7f7-c86316c7ea51 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:33.096128 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 807/1621] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:33.097852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ef237-bc31-4e1f-ab06-6d4266b90bf7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.098237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ef237-bc31-4e1f-ab06-6d4266b90bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.105688 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ef237-bc31-4e1f-ab06-6d4266b90bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.121018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6a26f-b6a8-4c48-a7f7-c86316c7ea51 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:33.128364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f1f6b-8aaf-4c66-8ed3-9499112a16a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:33.129662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f1f6b-8aaf-4c66-8ed3-9499112a16a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.129981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f1f6b-8aaf-4c66-8ed3-9499112a16a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.130265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f1f6b-8aaf-4c66-8ed3-9499112a16a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.130984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f1f6b-8aaf-4c66-8ed3-9499112a16a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:33.134430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9a1ef237-bc31-4e1f-ab06-6d4266b90bf7 None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:33.136752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9a1ef237-bc31-4e1f-ab06-6d4266b90bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:33.139299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f1f6b-8aaf-4c66-8ed3-9499112a16a2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:33.149089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 808/1622] 10.222.0.112 () {58 vars in 1063 bytes} [Fri Jun 3 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:33.150334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ef237-bc31-4e1f-ab06-6d4266b90bf7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:33.202764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 815/1623] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:33 2022] POST /identity/v3/projects => generated 386 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:33.203856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f1f6b-8aaf-4c66-8ed3-9499112a16a2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:33.216842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ef237-bc31-4e1f-ab06-6d4266b90bf7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:33.403037 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f1f6b-8aaf-4c66-8ed3-9499112a16a2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:33.406673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa5f9d-8642-4258-b112-ce84ec740479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:33.409852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa5f9d-8642-4258-b112-ce84ec740479 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.411422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa5f9d-8642-4258-b112-ce84ec740479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.412299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa5f9d-8642-4258-b112-ce84ec740479 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.414659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa5f9d-8642-4258-b112-ce84ec740479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:33.422819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa5f9d-8642-4258-b112-ce84ec740479 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:33.423541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba26de-5e02-4cae-a7a3-959ac01f88fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:33.426360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba26de-5e02-4cae-a7a3-959ac01f88fe service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.426908 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba26de-5e02-4cae-a7a3-959ac01f88fe service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.427793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba26de-5e02-4cae-a7a3-959ac01f88fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.516775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 809/1624] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:33 2022] POST /identity/v3/projects => generated 372 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:33.518142 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa5f9d-8642-4258-b112-ce84ec740479 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:33.538333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:33.558983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:33.585549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba26de-5e02-4cae-a7a3-959ac01f88fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:33.587387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba26de-5e02-4cae-a7a3-959ac01f88fe service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:33.658244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 816/1625] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:33.662923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba26de-5e02-4cae-a7a3-959ac01f88fe service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:33.698671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba26de-5e02-4cae-a7a3-959ac01f88fe service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:33.796409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa5f9d-8642-4258-b112-ce84ec740479 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:33.817817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c169f9-6300-423d-839d-fcfbded7cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:33.818616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c169f9-6300-423d-839d-fcfbded7cdec admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.818904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c169f9-6300-423d-839d-fcfbded7cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.824395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c169f9-6300-423d-839d-fcfbded7cdec admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.825120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c169f9-6300-423d-839d-fcfbded7cdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:33.842685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c169f9-6300-423d-839d-fcfbded7cdec admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:33.867108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77b9e1-8c1d-4be0-ac98-7a4cd083cb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:33.868649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b9e1-8c1d-4be0-ac98-7a4cd083cb8e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.868954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b9e1-8c1d-4be0-ac98-7a4cd083cb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.869241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b9e1-8c1d-4be0-ac98-7a4cd083cb8e admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.870065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77b9e1-8c1d-4be0-ac98-7a4cd083cb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:33.873293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77b9e1-8c1d-4be0-ac98-7a4cd083cb8e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:33.902297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 810/1626] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:33 2022] POST /identity/v3/users => generated 300 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:33.904121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594e116-d31d-4253-b9e5-b031a2389c8b None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.907869 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594e116-d31d-4253-b9e5-b031a2389c8b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.908608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594e116-d31d-4253-b9e5-b031a2389c8b None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.910881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 811/1627] 10.222.0.112 () {54 vars in 917 bytes} [Fri Jun 3 16:27:33 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:27:33.918296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594e116-d31d-4253-b9e5-b031a2389c8b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:33.924870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 817/1628] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:33 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:33.926786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b06b3-194f-4356-bf3c-a729feba1eae None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.927078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b06b3-194f-4356-bf3c-a729feba1eae None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.927369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b06b3-194f-4356-bf3c-a729feba1eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.946224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594e116-d31d-4253-b9e5-b031a2389c8b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:33.960418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-480b06b3-194f-4356-bf3c-a729feba1eae None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:33.962366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-480b06b3-194f-4356-bf3c-a729feba1eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:33.962785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82affff6-f00b-4593-a7d6-1238a2a617f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:33.963691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82affff6-f00b-4593-a7d6-1238a2a617f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:33.964011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82affff6-f00b-4593-a7d6-1238a2a617f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:33.964430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82affff6-f00b-4593-a7d6-1238a2a617f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:33.965377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82affff6-f00b-4593-a7d6-1238a2a617f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:33.967300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82affff6-f00b-4593-a7d6-1238a2a617f5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:33.996760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 812/1629] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:33 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:33.996760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82affff6-f00b-4593-a7d6-1238a2a617f5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:34.022166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82affff6-f00b-4593-a7d6-1238a2a617f5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:34.029237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbc96e-14c2-4ecc-8a97-5b8625811085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:34.030459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbc96e-14c2-4ecc-8a97-5b8625811085 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.030798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbc96e-14c2-4ecc-8a97-5b8625811085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.031081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbc96e-14c2-4ecc-8a97-5b8625811085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.033501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbc96e-14c2-4ecc-8a97-5b8625811085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:34.037144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbc96e-14c2-4ecc-8a97-5b8625811085 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:34.055715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 813/1630] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:33 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:34.056531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbc96e-14c2-4ecc-8a97-5b8625811085 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:34.067584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbc96e-14c2-4ecc-8a97-5b8625811085 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:34.078194 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d9203-10b2-48a2-a726-a672d0c36cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:34.080200 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9203-10b2-48a2-a726-a672d0c36cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.080484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9203-10b2-48a2-a726-a672d0c36cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.080761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d9203-10b2-48a2-a726-a672d0c36cc7 admin admin] PATH_INFO: `/v3/projects/b45cd15d1d354891bfecd24b65f4ff2e/users/34878797a93c4198a949f37795c600a6/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.124191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d9203-10b2-48a2-a726-a672d0c36cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45cd15d1d354891bfecd24b65f4ff2e, user_id=34878797a93c4198a949f37795c600a6, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:34.127537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d9203-10b2-48a2-a726-a672d0c36cc7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:34.140403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 818/1631] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:34.142095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b06b3-194f-4356-bf3c-a729feba1eae None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:34.170445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 814/1632] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:34 2022] PUT /identity/v3/projects/b45cd15d1d354891bfecd24b65f4ff2e/users/34878797a93c4198a949f37795c600a6/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:34.171002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b06b3-194f-4356-bf3c-a729feba1eae None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:34.174167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea637-560d-4fcc-a7fd-08d891272fc0 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.174167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea637-560d-4fcc-a7fd-08d891272fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.174442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea637-560d-4fcc-a7fd-08d891272fc0 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.177294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 815/1633] 10.222.0.112 () {54 vars in 917 bytes} [Fri Jun 3 16:27:34 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:27:34.178112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea637-560d-4fcc-a7fd-08d891272fc0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:34.184486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-279ea637-560d-4fcc-a7fd-08d891272fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:34.259445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:34.274789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea637-560d-4fcc-a7fd-08d891272fc0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:34.277573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800492c6-6aa1-4fbd-a3a3-c8585c621166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:34.278691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890faf4-cf32-42d1-84fb-f924c3ca7036 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f440bbc0414415186ae83d9fa3842bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:34.279368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890faf4-cf32-42d1-84fb-f924c3ca7036 service glance] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.279737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890faf4-cf32-42d1-84fb-f924c3ca7036 service glance] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.280027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890faf4-cf32-42d1-84fb-f924c3ca7036 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.281027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800492c6-6aa1-4fbd-a3a3-c8585c621166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.281703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800492c6-6aa1-4fbd-a3a3-c8585c621166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.282206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800492c6-6aa1-4fbd-a3a3-c8585c621166 admin admin] PATH_INFO: `/v3/projects/3d85aed9389f419b8a97fe4f1cd441f7/users/2fa826c05e7f46d2b91174594de4320c/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.328559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800492c6-6aa1-4fbd-a3a3-c8585c621166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d85aed9389f419b8a97fe4f1cd441f7, user_id=2fa826c05e7f46d2b91174594de4320c, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:34.334430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800492c6-6aa1-4fbd-a3a3-c8585c621166 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:34.371197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 819/1634] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:34 2022] PUT /identity/v3/projects/3d85aed9389f419b8a97fe4f1cd441f7/users/2fa826c05e7f46d2b91174594de4320c/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:34.372662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800492c6-6aa1-4fbd-a3a3-c8585c621166 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:34.388258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:34.399057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890faf4-cf32-42d1-84fb-f924c3ca7036 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:34.403035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890faf4-cf32-42d1-84fb-f924c3ca7036 service glance] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:34.438489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 816/1635] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:34.440649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90599f2-32fd-4823-8945-10d535d00bab None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.441220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90599f2-32fd-4823-8945-10d535d00bab None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.442276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90599f2-32fd-4823-8945-10d535d00bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.513515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e90599f2-32fd-4823-8945-10d535d00bab None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:34.518956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e90599f2-32fd-4823-8945-10d535d00bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:34.524136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800492c6-6aa1-4fbd-a3a3-c8585c621166 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:34.537209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67376154-82d6-4c6e-8386-12a15b3fa6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:34.537916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67376154-82d6-4c6e-8386-12a15b3fa6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.538208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67376154-82d6-4c6e-8386-12a15b3fa6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.538475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67376154-82d6-4c6e-8386-12a15b3fa6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.539231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67376154-82d6-4c6e-8386-12a15b3fa6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:34.544896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67376154-82d6-4c6e-8386-12a15b3fa6b7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:34.571525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 820/1636] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:34 2022] GET /identity/v3/roles => generated 1427 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:34.574375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67376154-82d6-4c6e-8386-12a15b3fa6b7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:34.600978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67376154-82d6-4c6e-8386-12a15b3fa6b7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:34.617219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d61c0-b3f6-4c56-b9ef-be91f7694bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:34.618424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d61c0-b3f6-4c56-b9ef-be91f7694bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.618717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d61c0-b3f6-4c56-b9ef-be91f7694bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.619048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d61c0-b3f6-4c56-b9ef-be91f7694bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.619786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d61c0-b3f6-4c56-b9ef-be91f7694bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:34.621469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d61c0-b3f6-4c56-b9ef-be91f7694bfb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:34.627270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 817/1637] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:27:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:34.628355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90599f2-32fd-4823-8945-10d535d00bab None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:34.642249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90599f2-32fd-4823-8945-10d535d00bab None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:34.648386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066226a2-3556-45cd-b5ca-708348e2ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:34.649314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066226a2-3556-45cd-b5ca-708348e2ea02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.649654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066226a2-3556-45cd-b5ca-708348e2ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.649941 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066226a2-3556-45cd-b5ca-708348e2ea02 admin admin] PATH_INFO: `/v3/projects/b45cd15d1d354891bfecd24b65f4ff2e/users/34878797a93c4198a949f37795c600a6/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.652146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066226a2-3556-45cd-b5ca-708348e2ea02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45cd15d1d354891bfecd24b65f4ff2e, user_id=34878797a93c4198a949f37795c600a6, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:34.656052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 821/1638] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:34 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:34.656052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d61c0-b3f6-4c56-b9ef-be91f7694bfb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:34.656253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066226a2-3556-45cd-b5ca-708348e2ea02 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:34.671851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 818/1639] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:34 2022] PUT /identity/v3/projects/b45cd15d1d354891bfecd24b65f4ff2e/users/34878797a93c4198a949f37795c600a6/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:34.673658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066226a2-3556-45cd-b5ca-708348e2ea02 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:34.786680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d61c0-b3f6-4c56-b9ef-be91f7694bfb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:34.807696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066226a2-3556-45cd-b5ca-708348e2ea02 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:34.820703 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62792b15-0498-4fd3-b3bb-cd38dae68f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:34.821650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62792b15-0498-4fd3-b3bb-cd38dae68f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.822007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62792b15-0498-4fd3-b3bb-cd38dae68f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.822218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62792b15-0498-4fd3-b3bb-cd38dae68f03 admin admin] PATH_INFO: `/v3/projects/3d85aed9389f419b8a97fe4f1cd441f7/users/2fa826c05e7f46d2b91174594de4320c/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.825955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62792b15-0498-4fd3-b3bb-cd38dae68f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d85aed9389f419b8a97fe4f1cd441f7, user_id=2fa826c05e7f46d2b91174594de4320c, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:34.829019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62792b15-0498-4fd3-b3bb-cd38dae68f03 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:34.853835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 819/1640] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:34 2022] PUT /identity/v3/projects/3d85aed9389f419b8a97fe4f1cd441f7/users/2fa826c05e7f46d2b91174594de4320c/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:34.855287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88152d6-925d-4ab4-b306-ea7579cd64a0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.855610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88152d6-925d-4ab4-b306-ea7579cd64a0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.855935 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88152d6-925d-4ab4-b306-ea7579cd64a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.890031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15a79-e339-48e3-9e47-46f5f89631dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:34.891175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15a79-e339-48e3-9e47-46f5f89631dd service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:34.891747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15a79-e339-48e3-9e47-46f5f89631dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:34.892293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15a79-e339-48e3-9e47-46f5f89631dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:34.916424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c88152d6-925d-4ab4-b306-ea7579cd64a0 None None] MFA Rules not processed for user `34878797a93c4198a949f37795c600a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:34.919231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c88152d6-925d-4ab4-b306-ea7579cd64a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:34.944830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:35.026596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb15a79-e339-48e3-9e47-46f5f89631dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:35.029403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb15a79-e339-48e3-9e47-46f5f89631dd service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:35.051765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 822/1641] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:35.054375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cfe0a-5437-4ec2-a5f3-ce2ab35cda2c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:35.054863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cfe0a-5437-4ec2-a5f3-ce2ab35cda2c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:35.055419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cfe0a-5437-4ec2-a5f3-ce2ab35cda2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:35.116348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-929cfe0a-5437-4ec2-a5f3-ce2ab35cda2c None None] MFA Rules not processed for user `2fa826c05e7f46d2b91174594de4320c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:35.118704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-929cfe0a-5437-4ec2-a5f3-ce2ab35cda2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:35.142036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:35.163167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 820/1642] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:35.179284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88152d6-925d-4ab4-b306-ea7579cd64a0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:35.282113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 823/1643] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:35.299832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88152d6-925d-4ab4-b306-ea7579cd64a0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:35.312619 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7020f-6711-4e47-8813-a43289d2a7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:35.313359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7020f-6711-4e47-8813-a43289d2a7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:35.313641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7020f-6711-4e47-8813-a43289d2a7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:35.313913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7020f-6711-4e47-8813-a43289d2a7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:35.340039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7020f-6711-4e47-8813-a43289d2a7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:35.341552 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7020f-6711-4e47-8813-a43289d2a7f4 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:35.373638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 821/1644] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:35.407384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12986-11e0-43e5-982c-4be0aa008176 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:35.407844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12986-11e0-43e5-982c-4be0aa008176 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:35.408229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12986-11e0-43e5-982c-4be0aa008176 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:35.410027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 824/1645] 10.222.0.112 () {54 vars in 917 bytes} [Fri Jun 3 16:27:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:27:35.423930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9b695-a722-462e-9be0-8d07987fcc7c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:35.424868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9b695-a722-462e-9be0-8d07987fcc7c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:35.425494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9b695-a722-462e-9be0-8d07987fcc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:35.499090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a12986-11e0-43e5-982c-4be0aa008176 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:35.521176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a12986-11e0-43e5-982c-4be0aa008176 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:35.550502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529ccf2-031c-441f-b3d2-86f89ea653bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:35.554628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529ccf2-031c-441f-b3d2-86f89ea653bb service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:35.554928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529ccf2-031c-441f-b3d2-86f89ea653bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:35.555213 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529ccf2-031c-441f-b3d2-86f89ea653bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:35.590271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a7b9b695-a722-462e-9be0-8d07987fcc7c None None] MFA Rules not processed for user `ed487d7f2dde42268c57a5330b6c5b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:35.593095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529ccf2-031c-441f-b3d2-86f89ea653bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:35.594367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a7b9b695-a722-462e-9be0-8d07987fcc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:35.608977 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529ccf2-031c-441f-b3d2-86f89ea653bb service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:35.654045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 825/1646] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:35.793120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 822/1647] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:27:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:35.810338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529ccf2-031c-441f-b3d2-86f89ea653bb service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:35.821841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529ccf2-031c-441f-b3d2-86f89ea653bb service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:35.834850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e4184-dc4d-4a20-8557-e83b1365d79b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:35.835804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9b695-a722-462e-9be0-8d07987fcc7c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:35.843327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e4184-dc4d-4a20-8557-e83b1365d79b service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:35.843656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e4184-dc4d-4a20-8557-e83b1365d79b service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:35.846233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e4184-dc4d-4a20-8557-e83b1365d79b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:35.872808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e4184-dc4d-4a20-8557-e83b1365d79b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:35.874300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e4184-dc4d-4a20-8557-e83b1365d79b service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:35.905138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 826/1648] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:36.006721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9b695-a722-462e-9be0-8d07987fcc7c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:36.021461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:36.022412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:36.022752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:36.023034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] PATH_INFO: `/v3/users/7efe80acf0684cd189ccf50e27f3acca` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:36.024526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efe80acf0684cd189ccf50e27f3acca)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:36.026751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:36.097963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:36.117723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efe80acf0684cd189ccf50e27f3acca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:36.118783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efe80acf0684cd189ccf50e27f3acca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:36.135073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efe80acf0684cd189ccf50e27f3acca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:36.147991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efe80acf0684cd189ccf50e27f3acca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:36.148761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efe80acf0684cd189ccf50e27f3acca'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:36.183384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 823/1649] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:27:35 2022] DELETE /identity/v3/users/7efe80acf0684cd189ccf50e27f3acca => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:36.184967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4eb86-edb5-4aeb-8c95-36a66b2ea24e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:36.185172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4eb86-edb5-4aeb-8c95-36a66b2ea24e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:36.185465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4eb86-edb5-4aeb-8c95-36a66b2ea24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:36.213422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:36.215175 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:36.243286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3af4eb86-edb5-4aeb-8c95-36a66b2ea24e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:36.247238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3af4eb86-edb5-4aeb-8c95-36a66b2ea24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:36.433663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 827/1650] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:36.479119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aa555-3bc6-4103-b37d-8315885fba13 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:36.499715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:36.501199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:36.501603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:36.502035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:36.509448 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:36.548866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4eb86-edb5-4aeb-8c95-36a66b2ea24e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:36.556914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3af4eb86-edb5-4aeb-8c95-36a66b2ea24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:36.620028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:36.712713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:36.719241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:36.735150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 824/1651] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:27:36.753075 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4eb86-edb5-4aeb-8c95-36a66b2ea24e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:36.772459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:36.774037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:36.782342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93160cf-7978-421e-8258-efe6561a86be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:36.784216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93160cf-7978-421e-8258-efe6561a86be service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:36.785472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93160cf-7978-421e-8258-efe6561a86be service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:36.785867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93160cf-7978-421e-8258-efe6561a86be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:36.808284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f56acd-7d75-417c-805d-0004ed7e30d9 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:36.813818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93160cf-7978-421e-8258-efe6561a86be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:36.815630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93160cf-7978-421e-8258-efe6561a86be service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:36.821825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:36.825352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:36.825838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:36.827934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] PATH_INFO: `/v3/users/ca8e5ae7c2144a72aa57b7d2ddd9b442` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:36.835291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8e5ae7c2144a72aa57b7d2ddd9b442)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:36.838881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:36.843912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 828/1652] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:27:37.014241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:37.027334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8e5ae7c2144a72aa57b7d2ddd9b442'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:37.031262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8e5ae7c2144a72aa57b7d2ddd9b442'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:37.078108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8e5ae7c2144a72aa57b7d2ddd9b442'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:37.157148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8e5ae7c2144a72aa57b7d2ddd9b442'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:37.157148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8e5ae7c2144a72aa57b7d2ddd9b442'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:37.205468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00144d7-5c28-4fea-ba8c-1a879b32ad83 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:37.206391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00144d7-5c28-4fea-ba8c-1a879b32ad83 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:37.207469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00144d7-5c28-4fea-ba8c-1a879b32ad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:37.209692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 825/1653] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:27:36 2022] DELETE /identity/v3/users/ca8e5ae7c2144a72aa57b7d2ddd9b442 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:37.256836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e00144d7-5c28-4fea-ba8c-1a879b32ad83 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:37.258628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e00144d7-5c28-4fea-ba8c-1a879b32ad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:37.426095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 829/1654] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:37.499169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:37.501374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:37.740919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a955cba-a20b-49f4-b6ed-f1e9241e17e1 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:37.748269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4695b4-2e5c-4bb5-9109-12ae6f960ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:37.748957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4695b4-2e5c-4bb5-9109-12ae6f960ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:37.749242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4695b4-2e5c-4bb5-9109-12ae6f960ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:37.749520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4695b4-2e5c-4bb5-9109-12ae6f960ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:37.772100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9371b0e-87f1-4bd8-8833-e4ac5fea8e67 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:37.772610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9371b0e-87f1-4bd8-8833-e4ac5fea8e67 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:37.774838 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9371b0e-87f1-4bd8-8833-e4ac5fea8e67 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:37.776548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 830/1655] 10.222.0.112 () {54 vars in 965 bytes} [Fri Jun 3 16:27:37 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jun 03 16:27:37.776884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4695b4-2e5c-4bb5-9109-12ae6f960ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:37.778432 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4695b4-2e5c-4bb5-9109-12ae6f960ef3 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:37.793804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d6aff-626a-4da0-8698-259d3015e741 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:37.795136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d6aff-626a-4da0-8698-259d3015e741 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:37.796211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d6aff-626a-4da0-8698-259d3015e741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:37.812218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 826/1656] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:37.855934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-687d6aff-626a-4da0-8698-259d3015e741 None None] MFA Rules not processed for user `88e5d3ba49164f55a063aa60643bd421`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:37.861675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-687d6aff-626a-4da0-8698-259d3015e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:38.132989 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 831/1657] 10.222.0.112 () {58 vars in 1062 bytes} [Fri Jun 3 16:27:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:38.155145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4695b4-2e5c-4bb5-9109-12ae6f960ef3 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:38.185004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4695b4-2e5c-4bb5-9109-12ae6f960ef3 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:38.211588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7279e-c71a-41c3-b872-d6720c6ec581 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:38.214060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7279e-c71a-41c3-b872-d6720c6ec581 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:38.214196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7279e-c71a-41c3-b872-d6720c6ec581 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:38.214482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7279e-c71a-41c3-b872-d6720c6ec581 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:38.224517 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5fc7279e-c71a-41c3-b872-d6720c6ec581 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:38.238033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d6aff-626a-4da0-8698-259d3015e741 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:38.240386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-687d6aff-626a-4da0-8698-259d3015e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:38.275244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d6aff-626a-4da0-8698-259d3015e741 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:38.278880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7279e-c71a-41c3-b872-d6720c6ec581 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:38.285932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7279e-c71a-41c3-b872-d6720c6ec581 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:38.291399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:38.296634 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:38.297556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:38.297843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] PATH_INFO: `/v3/projects/b0fa2c1a7b3547df9a7f0e04e1878e43` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:38.303758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0fa2c1a7b3547df9a7f0e04e1878e43)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:38.310086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:38.351386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 827/1658] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:38.488897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0fa2c1a7b3547df9a7f0e04e1878e43', 'request_id': 'req-9bd218b7-2d63-4130-89fa-02904f0c4986'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:38.493919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:38.527332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0fa2c1a7b3547df9a7f0e04e1878e43', 'request_id': 'req-9bd218b7-2d63-4130-89fa-02904f0c4986'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:38.550394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0fa2c1a7b3547df9a7f0e04e1878e43', 'request_id': 'req-9bd218b7-2d63-4130-89fa-02904f0c4986'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:38.596048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] The token cache is being invalidate because project b0fa2c1a7b3547df9a7f0e04e1878e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:27:38.601119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:38.603819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:38.606744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 832/1659] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:27:38 2022] DELETE /identity/v3/projects/b0fa2c1a7b3547df9a7f0e04e1878e43 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:38.610998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7279e-c71a-41c3-b872-d6720c6ec581 service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:38.631567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7279e-c71a-41c3-b872-d6720c6ec581 service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:38.822201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:38.826414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:38.826795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:38.827370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] PATH_INFO: `/v3/users/34878797a93c4198a949f37795c600a6` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:38.832647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=34878797a93c4198a949f37795c600a6)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:38.837807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:39.002224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34878797a93c4198a949f37795c600a6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:39.003276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34878797a93c4198a949f37795c600a6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:39.012894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:39.034762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34878797a93c4198a949f37795c600a6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:39.071963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34878797a93c4198a949f37795c600a6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:39.077424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34878797a93c4198a949f37795c600a6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:39.117360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 828/1660] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:27:38 2022] DELETE /identity/v3/users/34878797a93c4198a949f37795c600a6 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:39.446327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:39.448494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:39.477170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd218b7-2d63-4130-89fa-02904f0c4986 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:39.772823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:39.785567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:39.786182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:39.786560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:39.787133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] PATH_INFO: `/v3/projects/ac03899b05494e3589abc750cf89c480` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:39.788288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:39.789398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac03899b05494e3589abc750cf89c480)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:39.792702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:39.823902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb670eb-d175-4403-89e4-addf4baec9cb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:39.883690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:39.899735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:39.904026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:39.905359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] PATH_INFO: `/v3/users/32afd658bb6e4211a6f14c94fda8ab5f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:39.908711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32afd658bb6e4211a6f14c94fda8ab5f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:39.910954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:39.942674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac03899b05494e3589abc750cf89c480', 'request_id': 'req-1be6e438-c998-47a6-bbc5-d1412107251b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:39.971848 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac03899b05494e3589abc750cf89c480', 'request_id': 'req-1be6e438-c998-47a6-bbc5-d1412107251b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:39.991971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac03899b05494e3589abc750cf89c480', 'request_id': 'req-1be6e438-c998-47a6-bbc5-d1412107251b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:40.081791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] The token cache is being invalidate because project ac03899b05494e3589abc750cf89c480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:27:40.082154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:40.090285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:40.103604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 833/1661] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:27:39 2022] DELETE /identity/v3/projects/ac03899b05494e3589abc750cf89c480 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:40.107913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:40.110607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:40.166955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32afd658bb6e4211a6f14c94fda8ab5f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:40.181406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32afd658bb6e4211a6f14c94fda8ab5f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:40.236429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32afd658bb6e4211a6f14c94fda8ab5f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:40.272907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32afd658bb6e4211a6f14c94fda8ab5f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:40.274468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bbd58036-947e-49d8-b4ba-193384dceba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32afd658bb6e4211a6f14c94fda8ab5f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:40.330258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 829/1662] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:27:39 2022] DELETE /identity/v3/users/32afd658bb6e4211a6f14c94fda8ab5f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:40.335799 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d197c-fdff-4b60-b120-a0a69ab35cd7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:40.336150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d197c-fdff-4b60-b120-a0a69ab35cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:40.336442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d197c-fdff-4b60-b120-a0a69ab35cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:40.420374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c67d197c-fdff-4b60-b120-a0a69ab35cd7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:40.428024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c67d197c-fdff-4b60-b120-a0a69ab35cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:40.448788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6e438-c998-47a6-bbc5-d1412107251b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:40.496716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:40.671833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 830/1663] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:40.761838 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:40.767469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:40.770331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:40.770855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] PATH_INFO: `/v3/users/2fa826c05e7f46d2b91174594de4320c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:40.778222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa826c05e7f46d2b91174594de4320c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:40.780422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: WARNING py.warnings [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:27:40.780422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: warnings.warn(msg) Jun 03 16:27:40.780422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: Jun 03 16:27:40.796396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:40.880720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d197c-fdff-4b60-b120-a0a69ab35cd7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:40.882595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c67d197c-fdff-4b60-b120-a0a69ab35cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:41.071138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:41.093547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa826c05e7f46d2b91174594de4320c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:41.105197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa826c05e7f46d2b91174594de4320c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:41.115358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d197c-fdff-4b60-b120-a0a69ab35cd7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:41.125768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa826c05e7f46d2b91174594de4320c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:41.131972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa826c05e7f46d2b91174594de4320c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:41.136169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:41.137727 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:41.139690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:41.140029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:41.149477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:41.164819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c18d5cd3-6007-4a6a-b384-ff65741cfbf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa826c05e7f46d2b91174594de4320c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:41.189524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:41.191471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:41.232825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 831/1664] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:41.250519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 834/1665] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:27:40 2022] DELETE /identity/v3/users/2fa826c05e7f46d2b91174594de4320c => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:41.740598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:41.745456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:41.794833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ea5fc-92e9-4ab9-85c6-ffebd2664243 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:41.959886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:41.961791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:41.966531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:41.966827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] PATH_INFO: `/v3/projects/b45cd15d1d354891bfecd24b65f4ff2e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:41.968527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45cd15d1d354891bfecd24b65f4ff2e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:41.969580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: WARNING py.warnings [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:27:41.969580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: warnings.warn(msg) Jun 03 16:27:41.969580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: Jun 03 16:27:41.970781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:42.179161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45cd15d1d354891bfecd24b65f4ff2e', 'request_id': 'req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:42.217953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45cd15d1d354891bfecd24b65f4ff2e', 'request_id': 'req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:42.237188 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45cd15d1d354891bfecd24b65f4ff2e', 'request_id': 'req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:42.262730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] The token cache is being invalidate because project b45cd15d1d354891bfecd24b65f4ff2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:27:42.263415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:42.265919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cf34a75b-8bb5-458a-89ac-19bdd334cf0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:42.270362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 832/1666] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:27:41 2022] DELETE /identity/v3/projects/b45cd15d1d354891bfecd24b65f4ff2e => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:42.277593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730cc29-d68b-4d80-bc56-0ace6989df72 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:42.278401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730cc29-d68b-4d80-bc56-0ace6989df72 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:42.278788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730cc29-d68b-4d80-bc56-0ace6989df72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:42.341718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8fefd-dcd9-4800-9f13-5befe09a162b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:42.341940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1730cc29-d68b-4d80-bc56-0ace6989df72 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:42.342161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8fefd-dcd9-4800-9f13-5befe09a162b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:42.342316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8fefd-dcd9-4800-9f13-5befe09a162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:42.343088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1730cc29-d68b-4d80-bc56-0ace6989df72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:42.393890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-88b8fefd-dcd9-4800-9f13-5befe09a162b None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:42.397536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-88b8fefd-dcd9-4800-9f13-5befe09a162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:42.487070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 835/1667] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:42.497347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfb935-b5d8-4259-b9fb-70354e146017 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:42.497781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfb935-b5d8-4259-b9fb-70354e146017 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:42.498207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfb935-b5d8-4259-b9fb-70354e146017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:42.539325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-04dfb935-b5d8-4259-b9fb-70354e146017 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:42.540844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-04dfb935-b5d8-4259-b9fb-70354e146017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:42.554020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 833/1668] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:42.578799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 836/1669] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:42.583412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8fefd-dcd9-4800-9f13-5befe09a162b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:42.605449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8fefd-dcd9-4800-9f13-5befe09a162b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:42.620576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81855cb9-d143-460c-b00c-012de00a5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:42.621576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81855cb9-d143-460c-b00c-012de00a5c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:42.622513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81855cb9-d143-460c-b00c-012de00a5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:42.623256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81855cb9-d143-460c-b00c-012de00a5c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:42.624487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81855cb9-d143-460c-b00c-012de00a5c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:42.626912 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81855cb9-d143-460c-b00c-012de00a5c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:42.630668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81855cb9-d143-460c-b00c-012de00a5c47 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:42.661318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 834/1670] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:42.665935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfb935-b5d8-4259-b9fb-70354e146017 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:42.682379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfb935-b5d8-4259-b9fb-70354e146017 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:42.688293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2fe62-2810-4cc5-bdaa-dcbec059ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:42.689126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2fe62-2810-4cc5-bdaa-dcbec059ed23 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:42.689303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2fe62-2810-4cc5-bdaa-dcbec059ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:42.689539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2fe62-2810-4cc5-bdaa-dcbec059ed23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:42.690264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2fe62-2810-4cc5-bdaa-dcbec059ed23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:42.692313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2fe62-2810-4cc5-bdaa-dcbec059ed23 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:42.808314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 837/1671] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:42 2022] POST /identity/v3/projects => generated 362 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:42.810192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81855cb9-d143-460c-b00c-012de00a5c47 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:42.842579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81855cb9-d143-460c-b00c-012de00a5c47 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:42.853137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:42.857353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2fe62-2810-4cc5-bdaa-dcbec059ed23 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:42.861489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a9a2fe62-2810-4cc5-bdaa-dcbec059ed23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:42.886152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:43.014956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5cddb-06c1-415d-807f-d9a9dad0df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:43.021179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5cddb-06c1-415d-807f-d9a9dad0df74 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:43.021670 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5cddb-06c1-415d-807f-d9a9dad0df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:43.021959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5cddb-06c1-415d-807f-d9a9dad0df74 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:43.030754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5cddb-06c1-415d-807f-d9a9dad0df74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:43.033503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5cddb-06c1-415d-807f-d9a9dad0df74 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:43.077157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2fe62-2810-4cc5-bdaa-dcbec059ed23 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:43.080570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 835/1672] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:42 2022] POST /identity/v3/users => generated 282 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:43.086352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5cddb-06c1-415d-807f-d9a9dad0df74 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:43.096373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0604a1-4370-4be0-bbde-08f6f153ee57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:43.097126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0604a1-4370-4be0-bbde-08f6f153ee57 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:43.097995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0604a1-4370-4be0-bbde-08f6f153ee57 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:43.098096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5cddb-06c1-415d-807f-d9a9dad0df74 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:43.100330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0604a1-4370-4be0-bbde-08f6f153ee57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:43.117350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bda4a1-88f8-4245-8392-fce16ffb2932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:43.118051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda4a1-88f8-4245-8392-fce16ffb2932 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:43.118335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda4a1-88f8-4245-8392-fce16ffb2932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:43.118612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda4a1-88f8-4245-8392-fce16ffb2932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:43.119377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bda4a1-88f8-4245-8392-fce16ffb2932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:43.123796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bda4a1-88f8-4245-8392-fce16ffb2932 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:43.146033 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 836/1673] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:43 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:43.153340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bda4a1-88f8-4245-8392-fce16ffb2932 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:43.181578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bda4a1-88f8-4245-8392-fce16ffb2932 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:43.195192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24022a-48db-4a6a-bb80-3a61b4ddbeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:43.196605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24022a-48db-4a6a-bb80-3a61b4ddbeba admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:43.197327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24022a-48db-4a6a-bb80-3a61b4ddbeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:43.197906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24022a-48db-4a6a-bb80-3a61b4ddbeba admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:43.199190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24022a-48db-4a6a-bb80-3a61b4ddbeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:43.201580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24022a-48db-4a6a-bb80-3a61b4ddbeba admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:43.225002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 837/1674] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:43 2022] GET /identity/v3/roles => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:43.237597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24022a-48db-4a6a-bb80-3a61b4ddbeba admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:43.262866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24022a-48db-4a6a-bb80-3a61b4ddbeba admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:43.271006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd025f2b-9ba8-4d2c-9786-ab4d73165eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:43.272640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd025f2b-9ba8-4d2c-9786-ab4d73165eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:43.273035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd025f2b-9ba8-4d2c-9786-ab4d73165eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:43.273450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd025f2b-9ba8-4d2c-9786-ab4d73165eff admin admin] PATH_INFO: `/v3/projects/e0b0dbc8cfcb405a9053fc4a803b3815/users/9de917043a5244e9a809e0edae5f8481/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:43.275618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0604a1-4370-4be0-bbde-08f6f153ee57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:43.281257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0604a1-4370-4be0-bbde-08f6f153ee57 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:43.301282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd025f2b-9ba8-4d2c-9786-ab4d73165eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b0dbc8cfcb405a9053fc4a803b3815, user_id=9de917043a5244e9a809e0edae5f8481, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:43.304670 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd025f2b-9ba8-4d2c-9786-ab4d73165eff admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:43.323420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 838/1675] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:27:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:27:43.334087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 838/1676] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:43 2022] PUT /identity/v3/projects/e0b0dbc8cfcb405a9053fc4a803b3815/users/9de917043a5244e9a809e0edae5f8481/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:43.345886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e22808-26c2-4e95-a85a-cecc7c41343f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:43.346562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e22808-26c2-4e95-a85a-cecc7c41343f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:43.346665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e22808-26c2-4e95-a85a-cecc7c41343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:43.425954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-66e22808-26c2-4e95-a85a-cecc7c41343f None None] MFA Rules not processed for user `9de917043a5244e9a809e0edae5f8481`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:43.427515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-66e22808-26c2-4e95-a85a-cecc7c41343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:43.608431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 839/1677] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:27:43.674624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd025f2b-9ba8-4d2c-9786-ab4d73165eff admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:43.677462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fd025f2b-9ba8-4d2c-9786-ab4d73165eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:43.702183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e22808-26c2-4e95-a85a-cecc7c41343f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:43.704038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-66e22808-26c2-4e95-a85a-cecc7c41343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:43.809339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:43.870863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e22808-26c2-4e95-a85a-cecc7c41343f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:43.874483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f2035-ad71-4f7d-89fd-90b5879fa545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:43.875311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2035-ad71-4f7d-89fd-90b5879fa545 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:43.875752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2035-ad71-4f7d-89fd-90b5879fa545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:43.876140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2035-ad71-4f7d-89fd-90b5879fa545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:43.882625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd025f2b-9ba8-4d2c-9786-ab4d73165eff admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:43.902640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f2035-ad71-4f7d-89fd-90b5879fa545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:43.904166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:43.904462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f2035-ad71-4f7d-89fd-90b5879fa545 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:43.905612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:43.905899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:43.906178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] PATH_INFO: `/v3/users/92ace4f3dad3447f90ccb5abdb93f2fb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:43.907812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ace4f3dad3447f90ccb5abdb93f2fb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:43.913839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:43.921488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 840/1678] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:27:43.939857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f2035-ad71-4f7d-89fd-90b5879fa545 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:43.971767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f2035-ad71-4f7d-89fd-90b5879fa545 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:43.987056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:43.989257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:43.999225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:44.002851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] PATH_INFO: `/v3/users/9de917043a5244e9a809e0edae5f8481` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:44.004588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de917043a5244e9a809e0edae5f8481)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:44.006684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:44.114298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ace4f3dad3447f90ccb5abdb93f2fb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.118556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ace4f3dad3447f90ccb5abdb93f2fb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.119190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de917043a5244e9a809e0edae5f8481'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.121555 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de917043a5244e9a809e0edae5f8481'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.142648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de917043a5244e9a809e0edae5f8481'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.145229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de917043a5244e9a809e0edae5f8481'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.150092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:44.164440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de917043a5244e9a809e0edae5f8481'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.200450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ace4f3dad3447f90ccb5abdb93f2fb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.215253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 841/1679] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:27:43 2022] DELETE /identity/v3/users/9de917043a5244e9a809e0edae5f8481 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:44.217258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:44.220912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:44.236438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ace4f3dad3447f90ccb5abdb93f2fb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.242768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-684dd78c-9a62-4f78-8ba3-85b53ac71673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ace4f3dad3447f90ccb5abdb93f2fb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.279225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 839/1680] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:27:43 2022] DELETE /identity/v3/users/92ace4f3dad3447f90ccb5abdb93f2fb => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:44.284194 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86c90f-5546-4eaa-9ff4-125e169e9d54 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:44.285458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86c90f-5546-4eaa-9ff4-125e169e9d54 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:44.288915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86c90f-5546-4eaa-9ff4-125e169e9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:44.368445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-be86c90f-5546-4eaa-9ff4-125e169e9d54 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:44.377123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-be86c90f-5546-4eaa-9ff4-125e169e9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:44.451421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e607cd-a61e-442b-8cb1-2cbc473c2984 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:44.628533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:44.632471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:44.633487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:44.637013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] PATH_INFO: `/v3/projects/3d85aed9389f419b8a97fe4f1cd441f7` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:44.639379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d85aed9389f419b8a97fe4f1cd441f7)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:44.641482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:44.643609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:44.695023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 840/1681] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:44.696569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201632-92c5-4233-97d5-8176b2ba096e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:44.696569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201632-92c5-4233-97d5-8176b2ba096e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:44.696569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201632-92c5-4233-97d5-8176b2ba096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:44.771619 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9a201632-92c5-4233-97d5-8176b2ba096e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:44.790416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9a201632-92c5-4233-97d5-8176b2ba096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:44.822913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 841/1682] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:44.830144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3a2d-a87a-459c-91b5-d73e710434ab None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:44.830775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3a2d-a87a-459c-91b5-d73e710434ab None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:44.833604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3a2d-a87a-459c-91b5-d73e710434ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:44.874131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d85aed9389f419b8a97fe4f1cd441f7', 'request_id': 'req-124d3942-e154-4a0f-9871-f12617602ed2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.892584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d85aed9389f419b8a97fe4f1cd441f7', 'request_id': 'req-124d3942-e154-4a0f-9871-f12617602ed2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.907949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d85aed9389f419b8a97fe4f1cd441f7', 'request_id': 'req-124d3942-e154-4a0f-9871-f12617602ed2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.936958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] The token cache is being invalidate because project 3d85aed9389f419b8a97fe4f1cd441f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:27:44.937368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.939993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:44.944993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 842/1683] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:27:44 2022] DELETE /identity/v3/projects/3d85aed9389f419b8a97fe4f1cd441f7 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:44.946038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:44.956527 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:44.973159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3f6d3a2d-a87a-459c-91b5-d73e710434ab None None] MFA Rules not processed for user `0e073346668d44e49bd8b94737a6dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:44.976661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3f6d3a2d-a87a-459c-91b5-d73e710434ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:45.128467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3942-e154-4a0f-9871-f12617602ed2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:45.143379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a3369-8d64-4107-bcb7-ee544636b98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:45.144246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a3369-8d64-4107-bcb7-ee544636b98f service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:45.144529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a3369-8d64-4107-bcb7-ee544636b98f service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:45.144807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a3369-8d64-4107-bcb7-ee544636b98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:45.146846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-685a3369-8d64-4107-bcb7-ee544636b98f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:45.175899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 842/1684] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:45.177059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3a2d-a87a-459c-91b5-d73e710434ab None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:45.189402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3a2d-a87a-459c-91b5-d73e710434ab None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:45.201629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e7449-03b4-4afc-867b-c8ce2d31bdbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:45.202381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e7449-03b4-4afc-867b-c8ce2d31bdbb service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:45.202734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e7449-03b4-4afc-867b-c8ce2d31bdbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:45.203076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e7449-03b4-4afc-867b-c8ce2d31bdbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:45.208775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-876e7449-03b4-4afc-867b-c8ce2d31bdbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:45.284824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a3369-8d64-4107-bcb7-ee544636b98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:45.286326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a3369-8d64-4107-bcb7-ee544636b98f service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:45.311439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 843/1685] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:45.312731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487028-905a-4336-bea6-4ec922b0e2dc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:45.313026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487028-905a-4336-bea6-4ec922b0e2dc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:45.313410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487028-905a-4336-bea6-4ec922b0e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:45.317855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:45.351419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e7449-03b4-4afc-867b-c8ce2d31bdbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:45.353338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e7449-03b4-4afc-867b-c8ce2d31bdbb service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:45.367877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-58487028-905a-4336-bea6-4ec922b0e2dc None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:45.370701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-58487028-905a-4336-bea6-4ec922b0e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:45.394908 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 844/1686] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:45.396647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89615613-24df-4f87-85c2-54d4f776fc57 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:45.397082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89615613-24df-4f87-85c2-54d4f776fc57 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:45.397373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89615613-24df-4f87-85c2-54d4f776fc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:45.401511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 843/1687] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:45.409326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73159d95-b4c7-4511-b18f-f5ffd474151b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:45.409870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73159d95-b4c7-4511-b18f-f5ffd474151b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:45.410356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73159d95-b4c7-4511-b18f-f5ffd474151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:45.444437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-89615613-24df-4f87-85c2-54d4f776fc57 None None] MFA Rules not processed for user `ed487d7f2dde42268c57a5330b6c5b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:45.445714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-89615613-24df-4f87-85c2-54d4f776fc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:45.461971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 845/1688] 10.222.0.97 () {58 vars in 1019 bytes} [Fri Jun 3 16:27:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:45.463592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc4179-5ca1-4e88-bb5b-fe8a8598a524 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:45.463931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc4179-5ca1-4e88-bb5b-fe8a8598a524 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:45.464285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc4179-5ca1-4e88-bb5b-fe8a8598a524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:45.474540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-73159d95-b4c7-4511-b18f-f5ffd474151b None None] MFA Rules not processed for user `0e073346668d44e49bd8b94737a6dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:45.478810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-73159d95-b4c7-4511-b18f-f5ffd474151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:45.498797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 844/1689] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:45.508771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1acc4179-5ca1-4e88-bb5b-fe8a8598a524 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:45.510770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73159d95-b4c7-4511-b18f-f5ffd474151b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:45.512537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1acc4179-5ca1-4e88-bb5b-fe8a8598a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:45.516163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-73159d95-b4c7-4511-b18f-f5ffd474151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:45.532658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 846/1690] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:45.537367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc4179-5ca1-4e88-bb5b-fe8a8598a524 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:45.554220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc4179-5ca1-4e88-bb5b-fe8a8598a524 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:45.563386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683d8db-5e32-4d80-9d7d-e89a3add8378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:45.570871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683d8db-5e32-4d80-9d7d-e89a3add8378 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:45.571163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683d8db-5e32-4d80-9d7d-e89a3add8378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:45.571428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683d8db-5e32-4d80-9d7d-e89a3add8378 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:45.572230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683d8db-5e32-4d80-9d7d-e89a3add8378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:45.572540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683d8db-5e32-4d80-9d7d-e89a3add8378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:45.574243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683d8db-5e32-4d80-9d7d-e89a3add8378 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:45.604860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 847/1691] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:27:45.610510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683d8db-5e32-4d80-9d7d-e89a3add8378 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:45.624536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683d8db-5e32-4d80-9d7d-e89a3add8378 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:45.630863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7d96-dd20-4665-af95-a6bc76780609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:45.631762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7d96-dd20-4665-af95-a6bc76780609 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:45.632126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7d96-dd20-4665-af95-a6bc76780609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:45.632542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7d96-dd20-4665-af95-a6bc76780609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:45.633292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e7d96-dd20-4665-af95-a6bc76780609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:45.635455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e7d96-dd20-4665-af95-a6bc76780609 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:45.642568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:45.732329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 848/1692] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:45 2022] POST /identity/v3/projects => generated 386 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:45.736199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7d96-dd20-4665-af95-a6bc76780609 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:45.912458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73159d95-b4c7-4511-b18f-f5ffd474151b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:45.930038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7d96-dd20-4665-af95-a6bc76780609 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:45.942740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6262225-0ba0-43e1-9d83-9c7d943e0de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:45.944398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262225-0ba0-43e1-9d83-9c7d943e0de0 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:45.945078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262225-0ba0-43e1-9d83-9c7d943e0de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:45.945550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6262225-0ba0-43e1-9d83-9c7d943e0de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:45.979384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6262225-0ba0-43e1-9d83-9c7d943e0de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:45.984054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6262225-0ba0-43e1-9d83-9c7d943e0de0 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:46.009411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 849/1693] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:46.027044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6262225-0ba0-43e1-9d83-9c7d943e0de0 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:46.140940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7989b8-8ffb-4e48-b47f-e537d918f5bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:46.142048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7989b8-8ffb-4e48-b47f-e537d918f5bb service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:46.142527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7989b8-8ffb-4e48-b47f-e537d918f5bb service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:46.142970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7989b8-8ffb-4e48-b47f-e537d918f5bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:46.272478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6262225-0ba0-43e1-9d83-9c7d943e0de0 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:46.284755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb883a-42fe-4d4a-b390-9559b95b8897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:46.286197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb883a-42fe-4d4a-b390-9559b95b8897 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:46.286963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb883a-42fe-4d4a-b390-9559b95b8897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:46.287454 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb883a-42fe-4d4a-b390-9559b95b8897 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:46.288497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb883a-42fe-4d4a-b390-9559b95b8897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:46.295919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb883a-42fe-4d4a-b390-9559b95b8897 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:46.334581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7989b8-8ffb-4e48-b47f-e537d918f5bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:46.337784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7989b8-8ffb-4e48-b47f-e537d918f5bb service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:46.341533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 850/1694] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:46 2022] POST /identity/v3/users => generated 294 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:46.342765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb883a-42fe-4d4a-b390-9559b95b8897 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:46.347088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-82eb883a-42fe-4d4a-b390-9559b95b8897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:46.377349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb883a-42fe-4d4a-b390-9559b95b8897 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:46.386045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 845/1695] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 876 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:27:46.388038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7989b8-8ffb-4e48-b47f-e537d918f5bb service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:46.391672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:46.392884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:46.393383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:46.393896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] PATH_INFO: `/v3/projects/67e436bd400944c097c2fbdd51c7f8b4` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:46.397432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e436bd400944c097c2fbdd51c7f8b4)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:46.399688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:46.436168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7989b8-8ffb-4e48-b47f-e537d918f5bb service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:46.474315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924a297-39a0-4a2d-b3bf-384be32de637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:46.478759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924a297-39a0-4a2d-b3bf-384be32de637 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:46.479063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924a297-39a0-4a2d-b3bf-384be32de637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:46.482166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924a297-39a0-4a2d-b3bf-384be32de637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:46.486978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924a297-39a0-4a2d-b3bf-384be32de637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:46.494098 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924a297-39a0-4a2d-b3bf-384be32de637 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:46.552296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 846/1696] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:46 2022] GET /identity/v3/roles => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:46.561919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924a297-39a0-4a2d-b3bf-384be32de637 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:46.582824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:46.584143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e436bd400944c097c2fbdd51c7f8b4', 'request_id': 'req-4ef4948a-11a0-42a5-86d8-f7634a3ee329'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:46.598330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924a297-39a0-4a2d-b3bf-384be32de637 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:46.606687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e436bd400944c097c2fbdd51c7f8b4', 'request_id': 'req-4ef4948a-11a0-42a5-86d8-f7634a3ee329'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:46.628093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e436bd400944c097c2fbdd51c7f8b4', 'request_id': 'req-4ef4948a-11a0-42a5-86d8-f7634a3ee329'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:46.650891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:46.662340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] The token cache is being invalidate because project 67e436bd400944c097c2fbdd51c7f8b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:27:46.662789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:46.670674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4ef4948a-11a0-42a5-86d8-f7634a3ee329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:46.673306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 851/1697] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:27:46 2022] DELETE /identity/v3/projects/67e436bd400944c097c2fbdd51c7f8b4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:46.679793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3a5c8-eb3f-46c6-af5e-f193d711b075 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:46.680343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3a5c8-eb3f-46c6-af5e-f193d711b075 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:46.681553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3a5c8-eb3f-46c6-af5e-f193d711b075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:46.739871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-32f3a5c8-eb3f-46c6-af5e-f193d711b075 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:46.741245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-32f3a5c8-eb3f-46c6-af5e-f193d711b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:46.830436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60e1ad-b445-4172-a573-b2003ea478d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:46.831099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60e1ad-b445-4172-a573-b2003ea478d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:46.839637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60e1ad-b445-4172-a573-b2003ea478d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:46.840052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60e1ad-b445-4172-a573-b2003ea478d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:46.840864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60e1ad-b445-4172-a573-b2003ea478d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:46.850066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60e1ad-b445-4172-a573-b2003ea478d9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:46.893529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 852/1698] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:46.896010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2545a9-78df-4c8a-adcb-ab175de41da0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:46.896475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2545a9-78df-4c8a-adcb-ab175de41da0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:46.896757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 847/1699] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:46 2022] GET /identity/v3/roles => generated 1427 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:46.899264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60e1ad-b445-4172-a573-b2003ea478d9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:46.899476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2545a9-78df-4c8a-adcb-ab175de41da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:46.904565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7a60e1ad-b445-4172-a573-b2003ea478d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:46.940004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60e1ad-b445-4172-a573-b2003ea478d9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:46.958381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3d2545a9-78df-4c8a-adcb-ab175de41da0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:46.959836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3d2545a9-78df-4c8a-adcb-ab175de41da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:46.970775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527b183-32a2-472f-9707-8f462b4166e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:46.974488 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527b183-32a2-472f-9707-8f462b4166e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:46.977001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527b183-32a2-472f-9707-8f462b4166e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:46.977323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527b183-32a2-472f-9707-8f462b4166e7 admin admin] PATH_INFO: `/v3/projects/be6223e151804870abaf8df28e999299/users/bca845ba324344a5ab42ad6bd6c227fa/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.010997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 853/1700] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:47.016209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2545a9-78df-4c8a-adcb-ab175de41da0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:47.035500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2545a9-78df-4c8a-adcb-ab175de41da0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:47.051052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953e96-9c81-4be5-8970-29799f569eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:47.051948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953e96-9c81-4be5-8970-29799f569eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.052338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953e96-9c81-4be5-8970-29799f569eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.052719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953e96-9c81-4be5-8970-29799f569eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.053580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8953e96-9c81-4be5-8970-29799f569eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:47.053994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8953e96-9c81-4be5-8970-29799f569eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:47.055789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8953e96-9c81-4be5-8970-29799f569eb6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:47.056504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527b183-32a2-472f-9707-8f462b4166e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6223e151804870abaf8df28e999299, user_id=bca845ba324344a5ab42ad6bd6c227fa, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:47.073929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527b183-32a2-472f-9707-8f462b4166e7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:47.076581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 854/1701] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:27:47.081345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953e96-9c81-4be5-8970-29799f569eb6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:47.102576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953e96-9c81-4be5-8970-29799f569eb6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:47.118188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498cb3-8f85-4116-b8ee-966059048bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:47.118986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498cb3-8f85-4116-b8ee-966059048bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.119403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498cb3-8f85-4116-b8ee-966059048bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.119820 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498cb3-8f85-4116-b8ee-966059048bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.120640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37498cb3-8f85-4116-b8ee-966059048bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:47.122878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37498cb3-8f85-4116-b8ee-966059048bc3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:47.126183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 848/1702] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:46 2022] PUT /identity/v3/projects/be6223e151804870abaf8df28e999299/users/bca845ba324344a5ab42ad6bd6c227fa/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:47.145483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d187d32-db9f-4642-a7c7-47901b25955f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.147119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d187d32-db9f-4642-a7c7-47901b25955f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.147438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d187d32-db9f-4642-a7c7-47901b25955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.187153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 855/1703] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:47 2022] POST /identity/v3/projects => generated 366 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:47.188446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498cb3-8f85-4116-b8ee-966059048bc3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:47.283414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4d187d32-db9f-4642-a7c7-47901b25955f None None] MFA Rules not processed for user `bca845ba324344a5ab42ad6bd6c227fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:47.284717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4d187d32-db9f-4642-a7c7-47901b25955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:47.294651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498cb3-8f85-4116-b8ee-966059048bc3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:47.309023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6c1ff-1eb9-4fbb-94bf-14555853eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:47.310769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6c1ff-1eb9-4fbb-94bf-14555853eba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.313355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6c1ff-1eb9-4fbb-94bf-14555853eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.314739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6c1ff-1eb9-4fbb-94bf-14555853eba5 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.318754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6c1ff-1eb9-4fbb-94bf-14555853eba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:47.329617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6c1ff-1eb9-4fbb-94bf-14555853eba5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:47.409322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 856/1704] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:47 2022] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:47.410545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6c1ff-1eb9-4fbb-94bf-14555853eba5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:47.433010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 849/1705] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:47.434612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d187d32-db9f-4642-a7c7-47901b25955f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:47.454061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d187d32-db9f-4642-a7c7-47901b25955f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:47.466149 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6c1ff-1eb9-4fbb-94bf-14555853eba5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:47.473539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe1efc-7aa7-47e1-a9c2-0909bfaa4775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:47.474178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe1efc-7aa7-47e1-a9c2-0909bfaa4775 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.474469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe1efc-7aa7-47e1-a9c2-0909bfaa4775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.474752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe1efc-7aa7-47e1-a9c2-0909bfaa4775 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.475619 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe1efc-7aa7-47e1-a9c2-0909bfaa4775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:47.477684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe1efc-7aa7-47e1-a9c2-0909bfaa4775 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:47.500858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65055d04-eaad-4ff0-b385-2403c1ae177c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:47.501567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65055d04-eaad-4ff0-b385-2403c1ae177c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.522861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65055d04-eaad-4ff0-b385-2403c1ae177c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.523308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65055d04-eaad-4ff0-b385-2403c1ae177c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.524912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65055d04-eaad-4ff0-b385-2403c1ae177c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:47.533296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65055d04-eaad-4ff0-b385-2403c1ae177c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:47.554192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 850/1706] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:47 2022] POST /identity/v3/projects => generated 388 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:27:47.556696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe1efc-7aa7-47e1-a9c2-0909bfaa4775 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:47.570712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 857/1707] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:47 2022] GET /identity/v3/roles => generated 1427 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:47.575658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65055d04-eaad-4ff0-b385-2403c1ae177c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:47.633330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65055d04-eaad-4ff0-b385-2403c1ae177c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:47.741764 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:47.810145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe1efc-7aa7-47e1-a9c2-0909bfaa4775 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:47.821004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:47.832372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4436-08c9-4e1c-b5cb-8fc8071da9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:47.834541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4436-08c9-4e1c-b5cb-8fc8071da9ae admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.834859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4436-08c9-4e1c-b5cb-8fc8071da9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.835141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4436-08c9-4e1c-b5cb-8fc8071da9ae admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.836948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b4436-08c9-4e1c-b5cb-8fc8071da9ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:47.852096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b4436-08c9-4e1c-b5cb-8fc8071da9ae admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:47.902051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5916260-f87c-4170-98c8-9d28d2a27e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:47.902737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5916260-f87c-4170-98c8-9d28d2a27e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.903018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5916260-f87c-4170-98c8-9d28d2a27e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.903301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5916260-f87c-4170-98c8-9d28d2a27e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.905082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 851/1708] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:47 2022] POST /identity/v3/users => generated 295 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:47.905738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5916260-f87c-4170-98c8-9d28d2a27e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:47.908965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4436-08c9-4e1c-b5cb-8fc8071da9ae admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:47.913450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5916260-f87c-4170-98c8-9d28d2a27e3e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:47.934431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4436-08c9-4e1c-b5cb-8fc8071da9ae admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:47.943767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 858/1709] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:47 2022] GET /identity/v3/roles => generated 1427 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:47.946193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5916260-f87c-4170-98c8-9d28d2a27e3e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:47.950461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d622ba-0d86-4c24-a0c9-9e023cac7b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:47.953113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d622ba-0d86-4c24-a0c9-9e023cac7b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.954109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d622ba-0d86-4c24-a0c9-9e023cac7b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.954109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d622ba-0d86-4c24-a0c9-9e023cac7b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.957880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d622ba-0d86-4c24-a0c9-9e023cac7b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:47.959589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d622ba-0d86-4c24-a0c9-9e023cac7b69 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:47.975028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5916260-f87c-4170-98c8-9d28d2a27e3e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:47.987540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c1404-eddb-48df-a219-f8888665c3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:47.990461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c1404-eddb-48df-a219-f8888665c3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:47.991193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c1404-eddb-48df-a219-f8888665c3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:47.991484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c1404-eddb-48df-a219-f8888665c3eb admin admin] PATH_INFO: `/v3/projects/3638fb72e264460c80ab8469fd68f190/users/bb7ad3bffe79476b808a7015e5a2e70c/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:47.991701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 852/1710] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:47 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:47.994607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d622ba-0d86-4c24-a0c9-9e023cac7b69 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:48.023026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d622ba-0d86-4c24-a0c9-9e023cac7b69 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:48.038175 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047466b-c525-42e9-a668-92498c5ed44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:48.040428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c1404-eddb-48df-a219-f8888665c3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3638fb72e264460c80ab8469fd68f190, user_id=bb7ad3bffe79476b808a7015e5a2e70c, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:48.042828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047466b-c525-42e9-a668-92498c5ed44f admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:48.042828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047466b-c525-42e9-a668-92498c5ed44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:48.043182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047466b-c525-42e9-a668-92498c5ed44f admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:48.043774 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047466b-c525-42e9-a668-92498c5ed44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:48.046604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c1404-eddb-48df-a219-f8888665c3eb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:48.048290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047466b-c525-42e9-a668-92498c5ed44f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:48.089077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 859/1711] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:47 2022] PUT /identity/v3/projects/3638fb72e264460c80ab8469fd68f190/users/bb7ad3bffe79476b808a7015e5a2e70c/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:48.101357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 853/1712] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:47 2022] GET /identity/v3/roles => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:48.101855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163da79a-3762-4cfc-a135-bac784b4efab None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:48.102228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163da79a-3762-4cfc-a135-bac784b4efab None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:48.102558 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163da79a-3762-4cfc-a135-bac784b4efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:48.106736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047466b-c525-42e9-a668-92498c5ed44f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:48.137912 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047466b-c525-42e9-a668-92498c5ed44f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:48.206943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-163da79a-3762-4cfc-a135-bac784b4efab None None] MFA Rules not processed for user `bb7ad3bffe79476b808a7015e5a2e70c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:48.210576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-163da79a-3762-4cfc-a135-bac784b4efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:48.341201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488e622-c0c2-4e4c-a0cb-6c5bdb7e5c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:48.346255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e622-c0c2-4e4c-a0cb-6c5bdb7e5c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:48.347227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e622-c0c2-4e4c-a0cb-6c5bdb7e5c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:48.348734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e622-c0c2-4e4c-a0cb-6c5bdb7e5c9a admin admin] PATH_INFO: `/v3/projects/8e7104cfc00d48418bc9ba76ae6369de/users/28e9e6d1266648e3ac6a9fe719cd5107/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:48.387335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488e622-c0c2-4e4c-a0cb-6c5bdb7e5c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7104cfc00d48418bc9ba76ae6369de, user_id=28e9e6d1266648e3ac6a9fe719cd5107, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:48.394434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488e622-c0c2-4e4c-a0cb-6c5bdb7e5c9a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:48.410906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 860/1713] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:48.414896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163da79a-3762-4cfc-a135-bac784b4efab None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:48.438953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 854/1714] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:48 2022] PUT /identity/v3/projects/8e7104cfc00d48418bc9ba76ae6369de/users/28e9e6d1266648e3ac6a9fe719cd5107/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:27:48.450035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf559f1-ed28-44e7-8269-049d978b0f99 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:48.450331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf559f1-ed28-44e7-8269-049d978b0f99 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:48.450610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf559f1-ed28-44e7-8269-049d978b0f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:48.456269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163da79a-3762-4cfc-a135-bac784b4efab None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:48.555968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7bf559f1-ed28-44e7-8269-049d978b0f99 None None] MFA Rules not processed for user `28e9e6d1266648e3ac6a9fe719cd5107`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:48.565157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7bf559f1-ed28-44e7-8269-049d978b0f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:48.630279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7658b87-b7f1-4128-8345-331b12692d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:48.631054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7658b87-b7f1-4128-8345-331b12692d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:48.633631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7658b87-b7f1-4128-8345-331b12692d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:48.634740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7658b87-b7f1-4128-8345-331b12692d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:48.635795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7658b87-b7f1-4128-8345-331b12692d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:48.638430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7658b87-b7f1-4128-8345-331b12692d25 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:48.709663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 861/1715] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:48 2022] POST /identity/v3/projects => generated 364 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:48.719323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7658b87-b7f1-4128-8345-331b12692d25 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:48.794107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:48.832668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 855/1716] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:27:48.834447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf559f1-ed28-44e7-8269-049d978b0f99 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:48.840159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7bf559f1-ed28-44e7-8269-049d978b0f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:48.894916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf559f1-ed28-44e7-8269-049d978b0f99 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:48.913540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:48.915460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:48.916063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:48.916597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] PATH_INFO: `/v3/projects/adb5effed48748a9a52987c2a02a572b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:48.916712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7658b87-b7f1-4128-8345-331b12692d25 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:48.920608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb5effed48748a9a52987c2a02a572b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:48.923074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:48.936601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306c6b9-6ac0-4f53-aab6-5466f4c96aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:48.938298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306c6b9-6ac0-4f53-aab6-5466f4c96aab admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:48.938787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306c6b9-6ac0-4f53-aab6-5466f4c96aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:48.941743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306c6b9-6ac0-4f53-aab6-5466f4c96aab admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:48.942574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306c6b9-6ac0-4f53-aab6-5466f4c96aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:48.952656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306c6b9-6ac0-4f53-aab6-5466f4c96aab admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:49.002960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:49.021129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 862/1717] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:48 2022] POST /identity/v3/users => generated 289 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:49.023932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306c6b9-6ac0-4f53-aab6-5466f4c96aab admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:49.061727 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306c6b9-6ac0-4f53-aab6-5466f4c96aab admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:49.083403 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb5effed48748a9a52987c2a02a572b', 'request_id': 'req-1630551d-49e6-4f00-86e4-e535d6c4ad01'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.105380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb5effed48748a9a52987c2a02a572b', 'request_id': 'req-1630551d-49e6-4f00-86e4-e535d6c4ad01'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.147992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb5effed48748a9a52987c2a02a572b', 'request_id': 'req-1630551d-49e6-4f00-86e4-e535d6c4ad01'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.224439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] The token cache is being invalidate because project adb5effed48748a9a52987c2a02a572b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:27:49.224961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.232283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.234465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 856/1718] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:27:48 2022] DELETE /identity/v3/projects/adb5effed48748a9a52987c2a02a572b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:49.235633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:49.239796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:49.254202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332faa6-778d-4b1a-a661-3ceafd2d9a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:49.254976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332faa6-778d-4b1a-a661-3ceafd2d9a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:49.255267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332faa6-778d-4b1a-a661-3ceafd2d9a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:49.255567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332faa6-778d-4b1a-a661-3ceafd2d9a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:49.256301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332faa6-778d-4b1a-a661-3ceafd2d9a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:49.258356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332faa6-778d-4b1a-a661-3ceafd2d9a0b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:49.289635 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630551d-49e6-4f00-86e4-e535d6c4ad01 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:49.307607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:49.309413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:49.309825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:49.310225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] PATH_INFO: `/v3/projects/e0b0dbc8cfcb405a9053fc4a803b3815` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:49.322197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b0dbc8cfcb405a9053fc4a803b3815)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:49.322756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 863/1719] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:49 2022] POST /identity/v3/projects => generated 386 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:49.324147 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332faa6-778d-4b1a-a661-3ceafd2d9a0b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:49.327701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:49.330576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7332faa6-778d-4b1a-a661-3ceafd2d9a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:49.531697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332faa6-778d-4b1a-a661-3ceafd2d9a0b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:49.532593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b0dbc8cfcb405a9053fc4a803b3815', 'request_id': 'req-1bb671d0-9a98-46ea-8038-2335f38dccdf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.548741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b0dbc8cfcb405a9053fc4a803b3815', 'request_id': 'req-1bb671d0-9a98-46ea-8038-2335f38dccdf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.569645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b0dbc8cfcb405a9053fc4a803b3815', 'request_id': 'req-1bb671d0-9a98-46ea-8038-2335f38dccdf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.595232 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] The token cache is being invalidate because project e0b0dbc8cfcb405a9053fc4a803b3815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:27:49.595645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.599991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1bb671d0-9a98-46ea-8038-2335f38dccdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:27:49.604098 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 857/1720] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:27:49 2022] DELETE /identity/v3/projects/e0b0dbc8cfcb405a9053fc4a803b3815 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:49.608534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e11e7-bed2-4abd-b805-d09f099469f8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:49.608534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e11e7-bed2-4abd-b805-d09f099469f8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:49.608534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e11e7-bed2-4abd-b805-d09f099469f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:49.710182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:49.732309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2d2e11e7-bed2-4abd-b805-d09f099469f8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:49.733940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2d2e11e7-bed2-4abd-b805-d09f099469f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:49.779403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c1001-e98a-4d1a-b7ed-7a2985760cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:49.792274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c1001-e98a-4d1a-b7ed-7a2985760cda admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:49.792565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c1001-e98a-4d1a-b7ed-7a2985760cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:49.792850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c1001-e98a-4d1a-b7ed-7a2985760cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:49.797996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c1001-e98a-4d1a-b7ed-7a2985760cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:49.802841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c1001-e98a-4d1a-b7ed-7a2985760cda admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:49.850367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 864/1721] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:49 2022] GET /identity/v3/roles => generated 1427 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:49.853170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c1001-e98a-4d1a-b7ed-7a2985760cda admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:49.874580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6c8c1001-e98a-4d1a-b7ed-7a2985760cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:49.971036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c1001-e98a-4d1a-b7ed-7a2985760cda admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:49.990036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 858/1722] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:49.991771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bce6ac-b8a4-45b2-be62-dfbbd5045c31 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:49.994245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bce6ac-b8a4-45b2-be62-dfbbd5045c31 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:49.997918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bce6ac-b8a4-45b2-be62-dfbbd5045c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.009231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bdb63-d1a2-478a-9042-2bb9e21936d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:50.010171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bdb63-d1a2-478a-9042-2bb9e21936d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.010465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bdb63-d1a2-478a-9042-2bb9e21936d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.010752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bdb63-d1a2-478a-9042-2bb9e21936d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.022078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bdb63-d1a2-478a-9042-2bb9e21936d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:50.025013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bdb63-d1a2-478a-9042-2bb9e21936d3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:50.091264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c3bce6ac-b8a4-45b2-be62-dfbbd5045c31 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:50.093011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c3bce6ac-b8a4-45b2-be62-dfbbd5045c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:50.127638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 865/1723] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:49 2022] POST /identity/v3/users => generated 300 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:50.128990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bdb63-d1a2-478a-9042-2bb9e21936d3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:50.151679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-df4bdb63-d1a2-478a-9042-2bb9e21936d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:50.153061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 859/1724] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:50.154641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3b9b-3e9d-42cd-9fc1-93866dbb874b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.155632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3b9b-3e9d-42cd-9fc1-93866dbb874b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.155632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3b9b-3e9d-42cd-9fc1-93866dbb874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.202883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bdb63-d1a2-478a-9042-2bb9e21936d3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:50.214837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdad2fd-83a6-4555-a488-5c5420fe08fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:50.223046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad2fd-83a6-4555-a488-5c5420fe08fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.224360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad2fd-83a6-4555-a488-5c5420fe08fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.225021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdad2fd-83a6-4555-a488-5c5420fe08fa admin admin] PATH_INFO: `/v3/projects/397e779a77f143ab837ac0328131143d/users/e5270584d85d4550815b1c67da3e07e0/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.260113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0b9b3b9b-3e9d-42cd-9fc1-93866dbb874b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:50.261786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0b9b3b9b-3e9d-42cd-9fc1-93866dbb874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:50.297440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdad2fd-83a6-4555-a488-5c5420fe08fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=397e779a77f143ab837ac0328131143d, user_id=e5270584d85d4550815b1c67da3e07e0, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:50.300724 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 860/1725] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:50.302267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340b7b6-3181-4efb-adbb-0f87bfd6045e None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.302967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340b7b6-3181-4efb-adbb-0f87bfd6045e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.304648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340b7b6-3181-4efb-adbb-0f87bfd6045e None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.304782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdad2fd-83a6-4555-a488-5c5420fe08fa admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:50.306350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 861/1726] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:27:50 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:27:50.318912 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340b7b6-3181-4efb-adbb-0f87bfd6045e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:50.352120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 866/1727] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:50 2022] PUT /identity/v3/projects/397e779a77f143ab837ac0328131143d/users/e5270584d85d4550815b1c67da3e07e0/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:50.352804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2787f3-2060-4242-a27c-058234a60670 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.352917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2787f3-2060-4242-a27c-058234a60670 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.353261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2787f3-2060-4242-a27c-058234a60670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.364276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340b7b6-3181-4efb-adbb-0f87bfd6045e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:50.402350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9c2787f3-2060-4242-a27c-058234a60670 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:50.405372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9c2787f3-2060-4242-a27c-058234a60670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:50.413281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:50.582788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 867/1728] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:50.584047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2787f3-2060-4242-a27c-058234a60670 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:50.584806 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768ac8c-59d9-4670-91fa-8edaeca2c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:50.585718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768ac8c-59d9-4670-91fa-8edaeca2c07a admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.586120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768ac8c-59d9-4670-91fa-8edaeca2c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.586514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768ac8c-59d9-4670-91fa-8edaeca2c07a admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.587428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768ac8c-59d9-4670-91fa-8edaeca2c07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:50.589306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768ac8c-59d9-4670-91fa-8edaeca2c07a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:50.612301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2787f3-2060-4242-a27c-058234a60670 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:50.626353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30303694-0b4d-4381-b31a-143ed984fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:50.627115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30303694-0b4d-4381-b31a-143ed984fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.627466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30303694-0b4d-4381-b31a-143ed984fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.627769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30303694-0b4d-4381-b31a-143ed984fa78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.628732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30303694-0b4d-4381-b31a-143ed984fa78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:50.629050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30303694-0b4d-4381-b31a-143ed984fa78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:50.633965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 862/1729] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:50 2022] GET /identity/v3/roles => generated 1427 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:50.634945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30303694-0b4d-4381-b31a-143ed984fa78 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:50.635816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b007b-e10c-4ff7-b2b0-7333dd8ee963 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.638646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b007b-e10c-4ff7-b2b0-7333dd8ee963 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.641382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b007b-e10c-4ff7-b2b0-7333dd8ee963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.666465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 868/1730] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:50.667240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30303694-0b4d-4381-b31a-143ed984fa78 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:50.699769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30303694-0b4d-4381-b31a-143ed984fa78 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:50.702892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1a5b007b-e10c-4ff7-b2b0-7333dd8ee963 None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:50.709171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1a5b007b-e10c-4ff7-b2b0-7333dd8ee963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:50.715474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ee02-ae46-40c6-ba96-f59c9dee4646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:50.716398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ee02-ae46-40c6-ba96-f59c9dee4646 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.716686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ee02-ae46-40c6-ba96-f59c9dee4646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.716963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ee02-ae46-40c6-ba96-f59c9dee4646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.717717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ee02-ae46-40c6-ba96-f59c9dee4646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:50.719377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ee02-ae46-40c6-ba96-f59c9dee4646 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:50.755091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 869/1731] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:50 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:50.761265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ee02-ae46-40c6-ba96-f59c9dee4646 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:50.787295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ee02-ae46-40c6-ba96-f59c9dee4646 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:50.815418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8e3fa-0fd6-4345-95db-a844fe075068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:50.816862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8e3fa-0fd6-4345-95db-a844fe075068 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.817129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8e3fa-0fd6-4345-95db-a844fe075068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.817412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8e3fa-0fd6-4345-95db-a844fe075068 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.818166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8e3fa-0fd6-4345-95db-a844fe075068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:27:50.818474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8e3fa-0fd6-4345-95db-a844fe075068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:50.820244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8e3fa-0fd6-4345-95db-a844fe075068 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:50.863015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 870/1732] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:27:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:27:50.863015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8e3fa-0fd6-4345-95db-a844fe075068 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:50.888039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8e3fa-0fd6-4345-95db-a844fe075068 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:50.903660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbe965-7a4c-4371-acd0-c89e8cf7d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:50.904575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbe965-7a4c-4371-acd0-c89e8cf7d459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.905127 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbe965-7a4c-4371-acd0-c89e8cf7d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.905310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbe965-7a4c-4371-acd0-c89e8cf7d459 admin admin] PATH_INFO: `/v3/projects/48bde50702ce4be9b7f96923eb4efea4/users/c38cef1067154606993ef444f6900750/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.938532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 863/1733] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:50.940421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b007b-e10c-4ff7-b2b0-7333dd8ee963 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:50.968690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbe965-7a4c-4371-acd0-c89e8cf7d459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bde50702ce4be9b7f96923eb4efea4, user_id=c38cef1067154606993ef444f6900750, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:50.971599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbe965-7a4c-4371-acd0-c89e8cf7d459 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:50.972002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b007b-e10c-4ff7-b2b0-7333dd8ee963 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:50.988333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41fdf-44c0-4ca2-99b9-40a755a0daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:50.989170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41fdf-44c0-4ca2-99b9-40a755a0daf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:50.989741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41fdf-44c0-4ca2-99b9-40a755a0daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:50.990144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41fdf-44c0-4ca2-99b9-40a755a0daf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:50.991096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41fdf-44c0-4ca2-99b9-40a755a0daf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:50.999350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41fdf-44c0-4ca2-99b9-40a755a0daf8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:51.025756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 871/1734] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:50 2022] PUT /identity/v3/projects/48bde50702ce4be9b7f96923eb4efea4/users/c38cef1067154606993ef444f6900750/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:51.026359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbe965-7a4c-4371-acd0-c89e8cf7d459 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:51.111711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 864/1735] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:50 2022] POST /identity/v3/projects => generated 376 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:51.114784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41fdf-44c0-4ca2-99b9-40a755a0daf8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:51.264141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:51.346259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbe965-7a4c-4371-acd0-c89e8cf7d459 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:51.350925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41fdf-44c0-4ca2-99b9-40a755a0daf8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:51.356634 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fea43-22a1-40af-a212-7872e4253bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:51.357829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fea43-22a1-40af-a212-7872e4253bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:51.357990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fea43-22a1-40af-a212-7872e4253bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:51.358252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fea43-22a1-40af-a212-7872e4253bb9 admin admin] PATH_INFO: `/v3/projects/397e779a77f143ab837ac0328131143d/users/e5270584d85d4550815b1c67da3e07e0/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:51.361258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fea43-22a1-40af-a212-7872e4253bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397e779a77f143ab837ac0328131143d, user_id=e5270584d85d4550815b1c67da3e07e0, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:51.366251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fea43-22a1-40af-a212-7872e4253bb9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:51.381984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916013fc-d368-4938-ad1d-2995b6a1450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:51.382677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916013fc-d368-4938-ad1d-2995b6a1450f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:51.382962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916013fc-d368-4938-ad1d-2995b6a1450f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:51.383384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916013fc-d368-4938-ad1d-2995b6a1450f admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:51.384859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916013fc-d368-4938-ad1d-2995b6a1450f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:51.386813 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916013fc-d368-4938-ad1d-2995b6a1450f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:51.452931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 872/1736] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:51 2022] PUT /identity/v3/projects/397e779a77f143ab837ac0328131143d/users/e5270584d85d4550815b1c67da3e07e0/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:51.454140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fea43-22a1-40af-a212-7872e4253bb9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:51.540301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 865/1737] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:51 2022] POST /identity/v3/projects => generated 374 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:51.541379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916013fc-d368-4938-ad1d-2995b6a1450f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:51.555441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-916013fc-d368-4938-ad1d-2995b6a1450f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:51.589639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:51.796780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fea43-22a1-40af-a212-7872e4253bb9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:51.895159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916013fc-d368-4938-ad1d-2995b6a1450f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:51.908328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caea4d-9b95-4a5f-bd47-daedd76b593c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:51.909097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caea4d-9b95-4a5f-bd47-daedd76b593c service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:51.910171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caea4d-9b95-4a5f-bd47-daedd76b593c service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:51.910486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63caea4d-9b95-4a5f-bd47-daedd76b593c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:51.946373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caea4d-9b95-4a5f-bd47-daedd76b593c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:51.957257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63caea4d-9b95-4a5f-bd47-daedd76b593c service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:52.022377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 866/1738] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:52.023778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caea4d-9b95-4a5f-bd47-daedd76b593c service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:52.104544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666626a-83ab-4af2-b0cc-bdc363c6fa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:52.110608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666626a-83ab-4af2-b0cc-bdc363c6fa32 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:52.111102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666626a-83ab-4af2-b0cc-bdc363c6fa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:52.111445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666626a-83ab-4af2-b0cc-bdc363c6fa32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:52.112833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666626a-83ab-4af2-b0cc-bdc363c6fa32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:52.167747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666626a-83ab-4af2-b0cc-bdc363c6fa32 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:52.263772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 873/1739] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:51 2022] GET /identity/v3/roles => generated 1427 bytes in 810 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:52.265305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563359d-7178-4afa-bc59-17bd7d39a03b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:52.265647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563359d-7178-4afa-bc59-17bd7d39a03b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:52.265869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563359d-7178-4afa-bc59-17bd7d39a03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:52.429013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b563359d-7178-4afa-bc59-17bd7d39a03b None None] MFA Rules not processed for user `e5270584d85d4550815b1c67da3e07e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:52.436007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b563359d-7178-4afa-bc59-17bd7d39a03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:52.512556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63caea4d-9b95-4a5f-bd47-daedd76b593c service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:52.567740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786e8ae-35fd-4da7-82ab-a3769601c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:52.568444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786e8ae-35fd-4da7-82ab-a3769601c2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:52.568728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786e8ae-35fd-4da7-82ab-a3769601c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:52.568999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786e8ae-35fd-4da7-82ab-a3769601c2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:52.570078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786e8ae-35fd-4da7-82ab-a3769601c2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:52.589032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786e8ae-35fd-4da7-82ab-a3769601c2f6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:52.683881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 867/1740] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:52 2022] POST /identity/v3/users => generated 289 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:52.684841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786e8ae-35fd-4da7-82ab-a3769601c2f6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:52.736334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786e8ae-35fd-4da7-82ab-a3769601c2f6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:52.768811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d238-9710-4ba3-a514-941b20ad68b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:52.769528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d238-9710-4ba3-a514-941b20ad68b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:52.769800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d238-9710-4ba3-a514-941b20ad68b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:52.770066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d238-9710-4ba3-a514-941b20ad68b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:52.770776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d238-9710-4ba3-a514-941b20ad68b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:52.773839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d238-9710-4ba3-a514-941b20ad68b5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:52.823201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 874/1741] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 559 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:52.839320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82a112-2eaf-4282-8343-0b4a56e26b43 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:52.839642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82a112-2eaf-4282-8343-0b4a56e26b43 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:52.839642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82a112-2eaf-4282-8343-0b4a56e26b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:52.865271 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:52.882650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 868/1742] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:52 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:52.899408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d238-9710-4ba3-a514-941b20ad68b5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:52.929996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d238-9710-4ba3-a514-941b20ad68b5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:52.959823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7c82a112-2eaf-4282-8343-0b4a56e26b43 None None] MFA Rules not processed for user `b46af0c538244e1c9d2fe55470841d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:52.961053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7c82a112-2eaf-4282-8343-0b4a56e26b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:52.964928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa7f7-8027-45b1-8cb8-14062d61d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:52.966674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa7f7-8027-45b1-8cb8-14062d61d35d admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:52.967196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa7f7-8027-45b1-8cb8-14062d61d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:52.967733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa7f7-8027-45b1-8cb8-14062d61d35d admin admin] PATH_INFO: `/v3/projects/48bde50702ce4be9b7f96923eb4efea4/users/c38cef1067154606993ef444f6900750/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:52.972989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fa7f7-8027-45b1-8cb8-14062d61d35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bde50702ce4be9b7f96923eb4efea4, user_id=c38cef1067154606993ef444f6900750, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:52.992817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fa7f7-8027-45b1-8cb8-14062d61d35d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:53.045746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 869/1743] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:52 2022] PUT /identity/v3/projects/48bde50702ce4be9b7f96923eb4efea4/users/c38cef1067154606993ef444f6900750/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:53.046925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa7f7-8027-45b1-8cb8-14062d61d35d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:53.262538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:53.271624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 875/1744] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:53.271624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82a112-2eaf-4282-8343-0b4a56e26b43 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:53.284108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7c82a112-2eaf-4282-8343-0b4a56e26b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:53.290308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa7f7-8027-45b1-8cb8-14062d61d35d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:53.312267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419a54f-4d01-4c91-8902-2dec98322b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:53.312884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419a54f-4d01-4c91-8902-2dec98322b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:53.313316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419a54f-4d01-4c91-8902-2dec98322b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:53.313460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419a54f-4d01-4c91-8902-2dec98322b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:53.314177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419a54f-4d01-4c91-8902-2dec98322b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:53.316290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419a54f-4d01-4c91-8902-2dec98322b3f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:53.342640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 870/1745] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:53 2022] GET /identity/v3/roles => generated 1427 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:53.343594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419a54f-4d01-4c91-8902-2dec98322b3f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:53.386820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419a54f-4d01-4c91-8902-2dec98322b3f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:53.408421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfab98-742b-470c-aaa7-cfceb18e59d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:53.409555 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfab98-742b-470c-aaa7-cfceb18e59d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:53.410087 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfab98-742b-470c-aaa7-cfceb18e59d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:53.410552 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfab98-742b-470c-aaa7-cfceb18e59d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:53.412967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfab98-742b-470c-aaa7-cfceb18e59d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:53.420249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfab98-742b-470c-aaa7-cfceb18e59d0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:53.452348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 871/1746] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:53 2022] GET /identity/v3/roles => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:53.455188 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb8c3a-bf03-459e-ac68-59fa6baa0877 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:53.456523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb8c3a-bf03-459e-ac68-59fa6baa0877 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:53.457010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb8c3a-bf03-459e-ac68-59fa6baa0877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:53.518205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-47eb8c3a-bf03-459e-ac68-59fa6baa0877 None None] MFA Rules not processed for user `c38cef1067154606993ef444f6900750`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:53.520360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-47eb8c3a-bf03-459e-ac68-59fa6baa0877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:53.588765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82a112-2eaf-4282-8343-0b4a56e26b43 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:53.750047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecf82f-fe6c-4423-8c30-825b963a7811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:53.750731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecf82f-fe6c-4423-8c30-825b963a7811 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:53.751078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecf82f-fe6c-4423-8c30-825b963a7811 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:53.751279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecf82f-fe6c-4423-8c30-825b963a7811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:53.805275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 872/1747] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:53.806548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb8c3a-bf03-459e-ac68-59fa6baa0877 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:53.812313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-47eb8c3a-bf03-459e-ac68-59fa6baa0877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:53.928248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecf82f-fe6c-4423-8c30-825b963a7811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:53.929707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecf82f-fe6c-4423-8c30-825b963a7811 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:53.952025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:53.977702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 876/1748] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:53.978719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecf82f-fe6c-4423-8c30-825b963a7811 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:54.020792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecf82f-fe6c-4423-8c30-825b963a7811 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:54.042568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043369f-04e4-42de-822d-a87edda996a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:54.043277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043369f-04e4-42de-822d-a87edda996a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:54.043618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043369f-04e4-42de-822d-a87edda996a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:54.043877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043369f-04e4-42de-822d-a87edda996a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:54.044673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043369f-04e4-42de-822d-a87edda996a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:54.063000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043369f-04e4-42de-822d-a87edda996a8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:54.107916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb8c3a-bf03-459e-ac68-59fa6baa0877 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:54.112900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 877/1749] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:53 2022] GET /identity/v3/roles => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:54.113107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043369f-04e4-42de-822d-a87edda996a8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:54.128921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f3f74-b97b-4df8-8b58-c5b25522b082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:54.132265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f3f74-b97b-4df8-8b58-c5b25522b082 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:54.134141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f3f74-b97b-4df8-8b58-c5b25522b082 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:54.134501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f3f74-b97b-4df8-8b58-c5b25522b082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:54.146354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043369f-04e4-42de-822d-a87edda996a8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:54.156780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509d144-6924-4bc6-b678-9d024a93d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:54.157472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d144-6924-4bc6-b678-9d024a93d20e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:54.157754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d144-6924-4bc6-b678-9d024a93d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:54.160766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d144-6924-4bc6-b678-9d024a93d20e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:54.163961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509d144-6924-4bc6-b678-9d024a93d20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:54.165446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509d144-6924-4bc6-b678-9d024a93d20e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:54.202948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 878/1750] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:54 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:54.217537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0acd9-ad8b-4f89-a871-26c22842990a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:54.217812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0acd9-ad8b-4f89-a871-26c22842990a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:54.218100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0acd9-ad8b-4f89-a871-26c22842990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:54.283613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-70a0acd9-ad8b-4f89-a871-26c22842990a None None] MFA Rules not processed for user `0e073346668d44e49bd8b94737a6dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:54.285531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-70a0acd9-ad8b-4f89-a871-26c22842990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:54.363159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f3f74-b97b-4df8-8b58-c5b25522b082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:54.364876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f3f74-b97b-4df8-8b58-c5b25522b082 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:54.381232 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:54.399721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 873/1751] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:54.412313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f3f74-b97b-4df8-8b58-c5b25522b082 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:54.420124 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-da6f3f74-b97b-4df8-8b58-c5b25522b082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:54.510776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f3f74-b97b-4df8-8b58-c5b25522b082 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:54.522643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145c2f-9551-4d08-afa4-3fe49a6ff1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:54.523433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145c2f-9551-4d08-afa4-3fe49a6ff1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:54.523759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145c2f-9551-4d08-afa4-3fe49a6ff1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:54.524664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145c2f-9551-4d08-afa4-3fe49a6ff1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:54.559905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 879/1752] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:54.561083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0acd9-ad8b-4f89-a871-26c22842990a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:54.569163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32145c2f-9551-4d08-afa4-3fe49a6ff1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:54.570791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32145c2f-9551-4d08-afa4-3fe49a6ff1b9 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:54.595937 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 874/1753] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:54.599143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145c2f-9551-4d08-afa4-3fe49a6ff1b9 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:54.609979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0acd9-ad8b-4f89-a871-26c22842990a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:54.630493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cb48c-af77-447f-8ed5-75912d83a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:54.633397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145c2f-9551-4d08-afa4-3fe49a6ff1b9 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:54.633731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cb48c-af77-447f-8ed5-75912d83a5de admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:54.633989 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cb48c-af77-447f-8ed5-75912d83a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:54.634275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cb48c-af77-447f-8ed5-75912d83a5de admin admin] PATH_INFO: `/v3/projects/0131b7567c6d4c02b2c4dee14d080929/users/9a771a365be24da181f6e528ea033324/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:54.653800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e5b89-d60a-42c1-a895-30d673626722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:54.661997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e5b89-d60a-42c1-a895-30d673626722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:54.662267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e5b89-d60a-42c1-a895-30d673626722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:54.662559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e5b89-d60a-42c1-a895-30d673626722 admin admin] PATH_INFO: `/v3/projects/5a7b319e24e2458bbbb8b54997a74d17/users/416fa4acac4b49a0b053e225e4c9cc7d/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:54.684470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cb48c-af77-447f-8ed5-75912d83a5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0131b7567c6d4c02b2c4dee14d080929, user_id=9a771a365be24da181f6e528ea033324, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:54.687447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cb48c-af77-447f-8ed5-75912d83a5de admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:54.696481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e5b89-d60a-42c1-a895-30d673626722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7b319e24e2458bbbb8b54997a74d17, user_id=416fa4acac4b49a0b053e225e4c9cc7d, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:54.699802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e5b89-d60a-42c1-a895-30d673626722 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:54.723049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 880/1754] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:54 2022] PUT /identity/v3/projects/0131b7567c6d4c02b2c4dee14d080929/users/9a771a365be24da181f6e528ea033324/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:54.723049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cb48c-af77-447f-8ed5-75912d83a5de admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:54.765574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 875/1755] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:54 2022] PUT /identity/v3/projects/5a7b319e24e2458bbbb8b54997a74d17/users/416fa4acac4b49a0b053e225e4c9cc7d/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:54.769387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc09b-60cd-49ee-9c40-7dbc8e59486e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:54.769682 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc09b-60cd-49ee-9c40-7dbc8e59486e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:54.769961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc09b-60cd-49ee-9c40-7dbc8e59486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:54.887449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cb48c-af77-447f-8ed5-75912d83a5de admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:54.987812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-045fc09b-60cd-49ee-9c40-7dbc8e59486e None None] MFA Rules not processed for user `9a771a365be24da181f6e528ea033324`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:54.995646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-045fc09b-60cd-49ee-9c40-7dbc8e59486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:55.030000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0664de-8be5-461a-9ad6-6f8df79ecc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:55.030673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0664de-8be5-461a-9ad6-6f8df79ecc83 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:55.030964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0664de-8be5-461a-9ad6-6f8df79ecc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:55.031237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0664de-8be5-461a-9ad6-6f8df79ecc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:55.039135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4f0664de-8be5-461a-9ad6-6f8df79ecc83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:55.116408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:55.233793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0664de-8be5-461a-9ad6-6f8df79ecc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:55.235307 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0664de-8be5-461a-9ad6-6f8df79ecc83 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:55.261572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 881/1756] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:55.263083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ade62-fe56-468f-b39c-508a5808e1d0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:55.263675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ade62-fe56-468f-b39c-508a5808e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:55.263969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ade62-fe56-468f-b39c-508a5808e1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:55.323406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-577ade62-fe56-468f-b39c-508a5808e1d0 None None] MFA Rules not processed for user `416fa4acac4b49a0b053e225e4c9cc7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:55.335531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-577ade62-fe56-468f-b39c-508a5808e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:55.429440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 876/1757] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 657 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:55.472576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 882/1758] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:55.473853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fc09b-60cd-49ee-9c40-7dbc8e59486e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:55.870093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fc09b-60cd-49ee-9c40-7dbc8e59486e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:55.912121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5971-f215-4316-8bd0-136757495f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:55.913499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5971-f215-4316-8bd0-136757495f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:55.914035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5971-f215-4316-8bd0-136757495f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:55.914544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5971-f215-4316-8bd0-136757495f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:55.924489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b5971-f215-4316-8bd0-136757495f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:55.934311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b5971-f215-4316-8bd0-136757495f80 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:56.075047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 877/1759] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:27:55 2022] POST /identity/v3/projects => generated 374 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:27:56.079544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ade62-fe56-468f-b39c-508a5808e1d0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:56.110862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ade62-fe56-468f-b39c-508a5808e1d0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:56.341109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca0cca-78fd-423d-80d3-497d6ee62808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:56.341976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca0cca-78fd-423d-80d3-497d6ee62808 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:56.342267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca0cca-78fd-423d-80d3-497d6ee62808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:56.342569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca0cca-78fd-423d-80d3-497d6ee62808 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:56.343286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca0cca-78fd-423d-80d3-497d6ee62808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:56.352484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca0cca-78fd-423d-80d3-497d6ee62808 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:56.493814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5971-f215-4316-8bd0-136757495f80 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:56.494426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 883/1760] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:27:56 2022] POST /identity/v3/users => generated 294 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:27:56.513584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5971-f215-4316-8bd0-136757495f80 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:56.542980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c85f7-be47-4c71-98d0-26333ccd720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:56.547710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c85f7-be47-4c71-98d0-26333ccd720b admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:56.548089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c85f7-be47-4c71-98d0-26333ccd720b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:56.548884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c85f7-be47-4c71-98d0-26333ccd720b admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:56.551046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c85f7-be47-4c71-98d0-26333ccd720b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:56.563494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c85f7-be47-4c71-98d0-26333ccd720b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:56.571981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca0cca-78fd-423d-80d3-497d6ee62808 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:56.606987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 878/1761] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:56 2022] GET /identity/v3/roles => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:56.608038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c85f7-be47-4c71-98d0-26333ccd720b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:56.628822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c85f7-be47-4c71-98d0-26333ccd720b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:56.645289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bad96-539a-40f9-b199-1c507dec0943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:56.646212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bad96-539a-40f9-b199-1c507dec0943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:56.646498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bad96-539a-40f9-b199-1c507dec0943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:56.646781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bad96-539a-40f9-b199-1c507dec0943 admin admin] PATH_INFO: `/v3/projects/69853309a52248d79baa8ef724f974b4/users/dc03c67e94c94f58a103de90d1499ea9/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:56.688583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bad96-539a-40f9-b199-1c507dec0943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69853309a52248d79baa8ef724f974b4, user_id=dc03c67e94c94f58a103de90d1499ea9, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:56.707352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bad96-539a-40f9-b199-1c507dec0943 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:56.747796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:56.758848 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca0cca-78fd-423d-80d3-497d6ee62808 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:56.770542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 879/1762] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:56 2022] PUT /identity/v3/projects/69853309a52248d79baa8ef724f974b4/users/dc03c67e94c94f58a103de90d1499ea9/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:56.783130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bad96-539a-40f9-b199-1c507dec0943 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:56.802661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:56.912878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67613e1-2f26-4c7d-b37a-9df8492e9773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:56.913384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67613e1-2f26-4c7d-b37a-9df8492e9773 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:56.913738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67613e1-2f26-4c7d-b37a-9df8492e9773 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:56.914016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67613e1-2f26-4c7d-b37a-9df8492e9773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:56.925594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f67613e1-2f26-4c7d-b37a-9df8492e9773 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:57.026314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bad96-539a-40f9-b199-1c507dec0943 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:57.043136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8df8d-3e4d-4ce9-9522-5f0a62c29d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:57.046075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8df8d-3e4d-4ce9-9522-5f0a62c29d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:57.050497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8df8d-3e4d-4ce9-9522-5f0a62c29d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:57.052305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8df8d-3e4d-4ce9-9522-5f0a62c29d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:57.053261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8df8d-3e4d-4ce9-9522-5f0a62c29d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:57.061748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8df8d-3e4d-4ce9-9522-5f0a62c29d22 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:57.110910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 880/1763] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:27:56 2022] GET /identity/v3/roles => generated 1427 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:27:57.114061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8df8d-3e4d-4ce9-9522-5f0a62c29d22 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:57.161088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67613e1-2f26-4c7d-b37a-9df8492e9773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:57.167881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67613e1-2f26-4c7d-b37a-9df8492e9773 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:57.226757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 884/1764] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:57.231494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67613e1-2f26-4c7d-b37a-9df8492e9773 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:57.286446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67613e1-2f26-4c7d-b37a-9df8492e9773 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:57.313330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155e35b-c465-4da4-a20d-54005bcf9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:57.323510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e35b-c465-4da4-a20d-54005bcf9d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:57.324039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e35b-c465-4da4-a20d-54005bcf9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:57.324517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e35b-c465-4da4-a20d-54005bcf9d86 admin admin] PATH_INFO: `/v3/projects/69853309a52248d79baa8ef724f974b4/users/dc03c67e94c94f58a103de90d1499ea9/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:57.340455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155e35b-c465-4da4-a20d-54005bcf9d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69853309a52248d79baa8ef724f974b4, user_id=dc03c67e94c94f58a103de90d1499ea9, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:57.348795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8df8d-3e4d-4ce9-9522-5f0a62c29d22 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:57.360817 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155e35b-c465-4da4-a20d-54005bcf9d86 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:57.367733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af7b92-e4a7-448a-897e-49e990ff8249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:57.368900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af7b92-e4a7-448a-897e-49e990ff8249 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:57.369518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af7b92-e4a7-448a-897e-49e990ff8249 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:57.370235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af7b92-e4a7-448a-897e-49e990ff8249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:57.434360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 885/1765] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:27:57 2022] PUT /identity/v3/projects/69853309a52248d79baa8ef724f974b4/users/dc03c67e94c94f58a103de90d1499ea9/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:27:57.453997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5a0f0-7ec5-4825-9e6a-0fbdb2a9bef2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:57.454509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5a0f0-7ec5-4825-9e6a-0fbdb2a9bef2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:57.454939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5a0f0-7ec5-4825-9e6a-0fbdb2a9bef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:57.591244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af7b92-e4a7-448a-897e-49e990ff8249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:57.593315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af7b92-e4a7-448a-897e-49e990ff8249 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:57.603893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-97a5a0f0-7ec5-4825-9e6a-0fbdb2a9bef2 None None] MFA Rules not processed for user `dc03c67e94c94f58a103de90d1499ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:57.605374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-97a5a0f0-7ec5-4825-9e6a-0fbdb2a9bef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:57.644806 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 881/1766] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:57.945407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86511d3-67ef-45a8-b0ad-120311f21753 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:57.945898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86511d3-67ef-45a8-b0ad-120311f21753 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:57.946343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86511d3-67ef-45a8-b0ad-120311f21753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:57.979691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 886/1767] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:57.991614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae8310-b127-4e3c-a96f-0381dbdff2fc None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:57.992010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae8310-b127-4e3c-a96f-0381dbdff2fc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:57.992296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae8310-b127-4e3c-a96f-0381dbdff2fc None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:58.009481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 887/1768] 10.222.0.112 () {54 vars in 917 bytes} [Fri Jun 3 16:27:57 2022] GET /identity => generated 271 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:27:58.010984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c3b2-91f5-48ac-83a6-7da147f5da4f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:58.020154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c3b2-91f5-48ac-83a6-7da147f5da4f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:58.020476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c3b2-91f5-48ac-83a6-7da147f5da4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:58.105331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c86511d3-67ef-45a8-b0ad-120311f21753 None None] MFA Rules not processed for user `bdf91133123a468fbb8297092fd22484`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:58.113458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c86511d3-67ef-45a8-b0ad-120311f21753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:58.114232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4ee1c3b2-91f5-48ac-83a6-7da147f5da4f None None] MFA Rules not processed for user `ed487d7f2dde42268c57a5330b6c5b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:27:58.115339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4ee1c3b2-91f5-48ac-83a6-7da147f5da4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:58.220846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:58.230801 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:58.361366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 888/1769] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:27:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:58.394894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 882/1770] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:27:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:27:58.508887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c3b2-91f5-48ac-83a6-7da147f5da4f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:58.785147 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c3b2-91f5-48ac-83a6-7da147f5da4f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:58.811862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7c82a-f14d-427c-b091-df2e8e459fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:58.815422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7c82a-f14d-427c-b091-df2e8e459fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:58.817313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7c82a-f14d-427c-b091-df2e8e459fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:58.818289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7c82a-f14d-427c-b091-df2e8e459fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:59.099784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86511d3-67ef-45a8-b0ad-120311f21753 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:59.101408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c86511d3-67ef-45a8-b0ad-120311f21753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:27:59.132186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86511d3-67ef-45a8-b0ad-120311f21753 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:59.191243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7c82a-f14d-427c-b091-df2e8e459fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:59.197142 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba653a7d-75e4-459d-a3e8-6df3daeba7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:59.198171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba653a7d-75e4-459d-a3e8-6df3daeba7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:59.198768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7c82a-f14d-427c-b091-df2e8e459fd3 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:59.204013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba653a7d-75e4-459d-a3e8-6df3daeba7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:59.204945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba653a7d-75e4-459d-a3e8-6df3daeba7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:59.251856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba653a7d-75e4-459d-a3e8-6df3daeba7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:59.253743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 889/1771] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:27:59.255061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba653a7d-75e4-459d-a3e8-6df3daeba7d0 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:59.303695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 883/1772] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:27:59.463857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7c82a-f14d-427c-b091-df2e8e459fd3 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:27:59.743335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7c82a-f14d-427c-b091-df2e8e459fd3 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:27:59.750863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767e8dd-fec0-483a-b8c8-a4e220bd104f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:27:59.751804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e8dd-fec0-483a-b8c8-a4e220bd104f service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:27:59.752095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e8dd-fec0-483a-b8c8-a4e220bd104f service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:27:59.752388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767e8dd-fec0-483a-b8c8-a4e220bd104f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:27:59.765936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767e8dd-fec0-483a-b8c8-a4e220bd104f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:27:59.768481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767e8dd-fec0-483a-b8c8-a4e220bd104f service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:27:59.798676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 890/1773] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:27:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:00.085251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba653a7d-75e4-459d-a3e8-6df3daeba7d0 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:00.215232 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba653a7d-75e4-459d-a3e8-6df3daeba7d0 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:00.240648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:00.243792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:00.244820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:00.247234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] PATH_INFO: `/v3/users/9a771a365be24da181f6e528ea033324` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:00.252377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a771a365be24da181f6e528ea033324)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:00.256762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:00.406154 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a771a365be24da181f6e528ea033324'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:00.408387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a771a365be24da181f6e528ea033324'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:00.442364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a771a365be24da181f6e528ea033324'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:00.459791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a771a365be24da181f6e528ea033324'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:00.461715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a771a365be24da181f6e528ea033324'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:00.498436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 884/1774] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:00 2022] DELETE /identity/v3/users/9a771a365be24da181f6e528ea033324 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:00.503574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe202cf7-b6a8-4e35-a6eb-c7025522efb1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:00.504238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe202cf7-b6a8-4e35-a6eb-c7025522efb1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:00.504777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe202cf7-b6a8-4e35-a6eb-c7025522efb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:00.564280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fe202cf7-b6a8-4e35-a6eb-c7025522efb1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:00.569384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fe202cf7-b6a8-4e35-a6eb-c7025522efb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:00.600154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:00.756840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 891/1775] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:00.819172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:00.821862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:00.892849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:00.964370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52048d54-b0f6-4f10-9231-9d4cde25d2d2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:00.974335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07d17a-8833-4c80-81d7-dfc35893a027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:00.975310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07d17a-8833-4c80-81d7-dfc35893a027 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:00.975614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07d17a-8833-4c80-81d7-dfc35893a027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:00.975897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07d17a-8833-4c80-81d7-dfc35893a027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:01.025826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07d17a-8833-4c80-81d7-dfc35893a027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:01.029917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07d17a-8833-4c80-81d7-dfc35893a027 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:01.051904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 885/1776] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:01.167341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fadd47-bdc4-46db-af85-1ca97300cd8f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:01.167802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fadd47-bdc4-46db-af85-1ca97300cd8f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:01.167937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fadd47-bdc4-46db-af85-1ca97300cd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:01.207868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f0fadd47-bdc4-46db-af85-1ca97300cd8f None None] MFA Rules not processed for user `b46af0c538244e1c9d2fe55470841d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:01.209703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f0fadd47-bdc4-46db-af85-1ca97300cd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:01.363949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 892/1777] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:02.075893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07d17a-8833-4c80-81d7-dfc35893a027 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:02.077915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0a07d17a-8833-4c80-81d7-dfc35893a027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:02.130296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07d17a-8833-4c80-81d7-dfc35893a027 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:02.165719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:02.170673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:02.171870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:02.173123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] PATH_INFO: `/v3/projects/0131b7567c6d4c02b2c4dee14d080929` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:02.177834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0131b7567c6d4c02b2c4dee14d080929)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:02.192156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:02.371429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0131b7567c6d4c02b2c4dee14d080929', 'request_id': 'req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:02.389224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0131b7567c6d4c02b2c4dee14d080929', 'request_id': 'req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:02.421022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0131b7567c6d4c02b2c4dee14d080929', 'request_id': 'req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:02.464278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] The token cache is being invalidate because project 0131b7567c6d4c02b2c4dee14d080929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:02.464586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:02.465591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:02.473896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 886/1778] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:02 2022] DELETE /identity/v3/projects/0131b7567c6d4c02b2c4dee14d080929 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:02.479212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffbf8c-f906-4d29-836d-74c511708277 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:02.480197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffbf8c-f906-4d29-836d-74c511708277 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:02.480632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffbf8c-f906-4d29-836d-74c511708277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:02.532657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a1ffbf8c-f906-4d29-836d-74c511708277 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:02.534361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a1ffbf8c-f906-4d29-836d-74c511708277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:02.688077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:02.691671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:02.770223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 893/1779] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:02.772308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767ee0-1af1-47b2-88ec-4d2abf692995 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:02.772718 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767ee0-1af1-47b2-88ec-4d2abf692995 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:02.772925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e767ee0-1af1-47b2-88ec-4d2abf692995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:02.845816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1e767ee0-1af1-47b2-88ec-4d2abf692995 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:02.854090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1e767ee0-1af1-47b2-88ec-4d2abf692995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:02.919747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 894/1780] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:02.921430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767ee0-1af1-47b2-88ec-4d2abf692995 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:02.967186 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e767ee0-1af1-47b2-88ec-4d2abf692995 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:03.039768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed6ea-909c-4f4d-9c66-c6e2432c8617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:03.043520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed6ea-909c-4f4d-9c66-c6e2432c8617 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:03.044071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed6ea-909c-4f4d-9c66-c6e2432c8617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:03.044601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed6ea-909c-4f4d-9c66-c6e2432c8617 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:03.064492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed6ea-909c-4f4d-9c66-c6e2432c8617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:03.068760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89fbe2-1e24-45e7-bcd0-7b92d1e3f194 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:03.073061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed6ea-909c-4f4d-9c66-c6e2432c8617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:03.075061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed6ea-909c-4f4d-9c66-c6e2432c8617 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:03.084651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:03.086851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:03.088763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:03.090123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] PATH_INFO: `/v3/users/416fa4acac4b49a0b053e225e4c9cc7d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:03.095041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416fa4acac4b49a0b053e225e4c9cc7d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:03.100677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:03.133688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 895/1781] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:03.136573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed6ea-909c-4f4d-9c66-c6e2432c8617 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:03.184076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed6ea-909c-4f4d-9c66-c6e2432c8617 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:03.210136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c867-43c4-4624-ab33-c611c1b3891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:03.210845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c867-43c4-4624-ab33-c611c1b3891f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:03.211142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c867-43c4-4624-ab33-c611c1b3891f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:03.211414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c867-43c4-4624-ab33-c611c1b3891f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:03.220551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c867-43c4-4624-ab33-c611c1b3891f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:03.231725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c867-43c4-4624-ab33-c611c1b3891f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:03.363205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 896/1782] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:03 2022] POST /identity/v3/projects => generated 358 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:03.368623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c867-43c4-4624-ab33-c611c1b3891f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:03.499626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:03.603375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c867-43c4-4624-ab33-c611c1b3891f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:03.605427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416fa4acac4b49a0b053e225e4c9cc7d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:03.615086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416fa4acac4b49a0b053e225e4c9cc7d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:03.616603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecc402-1367-4507-8baf-a9ba20cb43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:03.617497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecc402-1367-4507-8baf-a9ba20cb43d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:03.617969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecc402-1367-4507-8baf-a9ba20cb43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:03.618383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecc402-1367-4507-8baf-a9ba20cb43d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:03.620387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecc402-1367-4507-8baf-a9ba20cb43d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:03.645747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:03.648364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecc402-1367-4507-8baf-a9ba20cb43d0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:03.657862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416fa4acac4b49a0b053e225e4c9cc7d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:03.680644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416fa4acac4b49a0b053e225e4c9cc7d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:03.682753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-efeba373-5e0d-4e80-90d4-841f56ccbad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416fa4acac4b49a0b053e225e4c9cc7d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:03.712823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 887/1783] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:02 2022] DELETE /identity/v3/users/416fa4acac4b49a0b053e225e4c9cc7d => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:03.717599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0d56-fea7-4c6e-a96a-99cc8e8e9f56 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:03.718333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0d56-fea7-4c6e-a96a-99cc8e8e9f56 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:03.718771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0d56-fea7-4c6e-a96a-99cc8e8e9f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:03.749277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 897/1784] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:03 2022] POST /identity/v3/users => generated 280 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:03.754059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecc402-1367-4507-8baf-a9ba20cb43d0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:03.757200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-95ecc402-1367-4507-8baf-a9ba20cb43d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:03.770902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-95cf0d56-fea7-4c6e-a96a-99cc8e8e9f56 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:03.774666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-95cf0d56-fea7-4c6e-a96a-99cc8e8e9f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:03.814136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecc402-1367-4507-8baf-a9ba20cb43d0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:03.950965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f21802-aafd-4d56-b7a5-53b965bdd6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:03.951680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21802-aafd-4d56-b7a5-53b965bdd6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:03.956181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21802-aafd-4d56-b7a5-53b965bdd6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:03.956769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21802-aafd-4d56-b7a5-53b965bdd6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:03.957928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f21802-aafd-4d56-b7a5-53b965bdd6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:03.960623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f21802-aafd-4d56-b7a5-53b965bdd6a7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:03.976419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 888/1785] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:03.984233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 898/1786] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:03 2022] GET /identity/v3/roles => generated 1427 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:03.988873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0d56-fea7-4c6e-a96a-99cc8e8e9f56 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:04.004845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0d56-fea7-4c6e-a96a-99cc8e8e9f56 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:04.012871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144e7c-21b0-45af-8df6-18f042acbd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:04.014298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144e7c-21b0-45af-8df6-18f042acbd90 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:04.014866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144e7c-21b0-45af-8df6-18f042acbd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:04.015350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144e7c-21b0-45af-8df6-18f042acbd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:04.016679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04144e7c-21b0-45af-8df6-18f042acbd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:04.020043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04144e7c-21b0-45af-8df6-18f042acbd90 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:04.027186 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f21802-aafd-4d56-b7a5-53b965bdd6a7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:04.036294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f1f21802-aafd-4d56-b7a5-53b965bdd6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:04.090352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 889/1787] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:03 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:04.092406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144e7c-21b0-45af-8df6-18f042acbd90 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:04.094557 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-04144e7c-21b0-45af-8df6-18f042acbd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:04.196972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144e7c-21b0-45af-8df6-18f042acbd90 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:04.202792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f18575-a974-4ebf-8604-9637fe9eb3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:04.204204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18575-a974-4ebf-8604-9637fe9eb3ed service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:04.205608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18575-a974-4ebf-8604-9637fe9eb3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:04.206722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18575-a974-4ebf-8604-9637fe9eb3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:04.214081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-89f18575-a974-4ebf-8604-9637fe9eb3ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:04.245652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f21802-aafd-4d56-b7a5-53b965bdd6a7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:04.253095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d6588-e875-482e-9605-917919695115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:04.254082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d6588-e875-482e-9605-917919695115 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:04.254495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d6588-e875-482e-9605-917919695115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:04.254987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d6588-e875-482e-9605-917919695115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:04.281407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d6588-e875-482e-9605-917919695115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:04.286142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d6588-e875-482e-9605-917919695115 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:04.306558 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 899/1788] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:04.306838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f18575-a974-4ebf-8604-9637fe9eb3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:04.308241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d6588-e875-482e-9605-917919695115 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:04.310049 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f18575-a974-4ebf-8604-9637fe9eb3ed service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:04.326107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d6588-e875-482e-9605-917919695115 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:04.336723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 890/1789] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:04.338184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6ff1a-bfa7-4519-9830-9b9e90c707e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:04.339722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6ff1a-bfa7-4519-9830-9b9e90c707e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:04.340177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6ff1a-bfa7-4519-9830-9b9e90c707e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:04.340693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6ff1a-bfa7-4519-9830-9b9e90c707e2 admin admin] PATH_INFO: `/v3/projects/2ee1ca21799b4a1db4ae67844af326c7/users/8943932eca9e4da88a025e9b8cde38c1/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:04.368206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6ff1a-bfa7-4519-9830-9b9e90c707e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee1ca21799b4a1db4ae67844af326c7, user_id=8943932eca9e4da88a025e9b8cde38c1, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:04.375636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6ff1a-bfa7-4519-9830-9b9e90c707e2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:04.415735 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 900/1790] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:04 2022] PUT /identity/v3/projects/2ee1ca21799b4a1db4ae67844af326c7/users/8943932eca9e4da88a025e9b8cde38c1/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:04.419077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce53f-2112-4bb5-98f5-f4355da77d47 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:04.419417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce53f-2112-4bb5-98f5-f4355da77d47 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:04.419720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce53f-2112-4bb5-98f5-f4355da77d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:04.486037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d17ce53f-2112-4bb5-98f5-f4355da77d47 None None] MFA Rules not processed for user `8943932eca9e4da88a025e9b8cde38c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:04.490017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d17ce53f-2112-4bb5-98f5-f4355da77d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:04.546275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:04.696683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 891/1791] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:04.701824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6ff1a-bfa7-4519-9830-9b9e90c707e2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:04.796878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:04.878547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6ff1a-bfa7-4519-9830-9b9e90c707e2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:04.886748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28710dfc-0d13-4991-b4e0-d314e474e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:04.887432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28710dfc-0d13-4991-b4e0-d314e474e2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:04.887749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28710dfc-0d13-4991-b4e0-d314e474e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:04.888025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28710dfc-0d13-4991-b4e0-d314e474e2b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:04.888913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28710dfc-0d13-4991-b4e0-d314e474e2b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:04.891227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28710dfc-0d13-4991-b4e0-d314e474e2b5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:04.930755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 901/1792] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:04 2022] POST /identity/v3/projects => generated 356 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:04.933604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce53f-2112-4bb5-98f5-f4355da77d47 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:04.960583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce53f-2112-4bb5-98f5-f4355da77d47 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:05.207742 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0f7fe-ca74-41c1-824d-fbf6698bbb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:05.209926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0f7fe-ca74-41c1-824d-fbf6698bbb1a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:05.210428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0f7fe-ca74-41c1-824d-fbf6698bbb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:05.211079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0f7fe-ca74-41c1-824d-fbf6698bbb1a admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:05.213253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0f7fe-ca74-41c1-824d-fbf6698bbb1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:05.216898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0f7fe-ca74-41c1-824d-fbf6698bbb1a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:05.292089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 892/1793] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:04 2022] POST /identity/v3/users => generated 285 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:05.300305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28710dfc-0d13-4991-b4e0-d314e474e2b5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:05.320279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28710dfc-0d13-4991-b4e0-d314e474e2b5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:05.329369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635a672-005a-48ef-b136-ec8afa1de5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:05.331510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635a672-005a-48ef-b136-ec8afa1de5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:05.331852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635a672-005a-48ef-b136-ec8afa1de5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:05.332130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635a672-005a-48ef-b136-ec8afa1de5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:05.335435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635a672-005a-48ef-b136-ec8afa1de5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:05.338793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635a672-005a-48ef-b136-ec8afa1de5c5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:05.402156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 902/1794] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:05 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:05.403435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0f7fe-ca74-41c1-824d-fbf6698bbb1a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:05.420566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0f7fe-ca74-41c1-824d-fbf6698bbb1a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:05.446825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c8750-03ae-463c-905f-3ec696182725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:05.448371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8750-03ae-463c-905f-3ec696182725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:05.449081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8750-03ae-463c-905f-3ec696182725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:05.449277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8750-03ae-463c-905f-3ec696182725 admin admin] PATH_INFO: `/v3/projects/e299c8e6cd6a47f1a672a43b58f9215b/users/6afad9af88a0474f83ce88ba29ee2d9a/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:05.505273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c8750-03ae-463c-905f-3ec696182725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e299c8e6cd6a47f1a672a43b58f9215b, user_id=6afad9af88a0474f83ce88ba29ee2d9a, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:05.508830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c8750-03ae-463c-905f-3ec696182725 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:05.554230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 893/1795] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:05 2022] PUT /identity/v3/projects/e299c8e6cd6a47f1a672a43b58f9215b/users/6afad9af88a0474f83ce88ba29ee2d9a/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:05.558547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635a672-005a-48ef-b136-ec8afa1de5c5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:05.576240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635a672-005a-48ef-b136-ec8afa1de5c5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:05.688147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f887ec-f50d-4d70-b64a-8de5b6276c48 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:05.688413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f887ec-f50d-4d70-b64a-8de5b6276c48 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:05.688691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f887ec-f50d-4d70-b64a-8de5b6276c48 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:05.691679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 894/1796] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:28:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:28:05.771948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f8ca1-6dbf-4710-9bc4-4174efa894d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:05.773337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8ca1-6dbf-4710-9bc4-4174efa894d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:05.774004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8ca1-6dbf-4710-9bc4-4174efa894d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:05.774436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f8ca1-6dbf-4710-9bc4-4174efa894d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:05.775490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f8ca1-6dbf-4710-9bc4-4174efa894d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:05.778098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f8ca1-6dbf-4710-9bc4-4174efa894d5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:05.800418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 903/1797] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:05 2022] GET /identity/v3/roles => generated 1427 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:05.804460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f887ec-f50d-4d70-b64a-8de5b6276c48 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:05.854397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f887ec-f50d-4d70-b64a-8de5b6276c48 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:05.873629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13d228-908c-419f-bb6e-a58291385d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:05.875051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13d228-908c-419f-bb6e-a58291385d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:05.877111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13d228-908c-419f-bb6e-a58291385d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:05.878277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13d228-908c-419f-bb6e-a58291385d97 admin admin] PATH_INFO: `/v3/projects/e299c8e6cd6a47f1a672a43b58f9215b/users/6afad9af88a0474f83ce88ba29ee2d9a/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:05.889504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13d228-908c-419f-bb6e-a58291385d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e299c8e6cd6a47f1a672a43b58f9215b, user_id=6afad9af88a0474f83ce88ba29ee2d9a, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:05.905535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13d228-908c-419f-bb6e-a58291385d97 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:05.951751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 895/1798] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:05 2022] PUT /identity/v3/projects/e299c8e6cd6a47f1a672a43b58f9215b/users/6afad9af88a0474f83ce88ba29ee2d9a/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:05.963681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e14c7-f658-45a5-bc6b-98d74c93b21e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:05.964017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e14c7-f658-45a5-bc6b-98d74c93b21e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:05.964254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e14c7-f658-45a5-bc6b-98d74c93b21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:06.001413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215956-1005-48cf-a220-5b43613d77d5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:06.001701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215956-1005-48cf-a220-5b43613d77d5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:06.002239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215956-1005-48cf-a220-5b43613d77d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:06.060786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-669e14c7-f658-45a5-bc6b-98d74c93b21e None None] MFA Rules not processed for user `6afad9af88a0474f83ce88ba29ee2d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:06.062753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-669e14c7-f658-45a5-bc6b-98d74c93b21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:06.063476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-aa215956-1005-48cf-a220-5b43613d77d5 None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:06.068748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-aa215956-1005-48cf-a220-5b43613d77d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:06.222427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:06.260274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 896/1799] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:06.273177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 904/1800] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:06.273378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215956-1005-48cf-a220-5b43613d77d5 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:06.278108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-aa215956-1005-48cf-a220-5b43613d77d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:06.285082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e14c7-f658-45a5-bc6b-98d74c93b21e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:06.374453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:06.428699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215956-1005-48cf-a220-5b43613d77d5 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:06.447349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e14c7-f658-45a5-bc6b-98d74c93b21e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:06.453997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:06.455290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:06.455716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:06.456067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] PATH_INFO: `/v3/projects/5a7b319e24e2458bbbb8b54997a74d17` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:06.457499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7b319e24e2458bbbb8b54997a74d17)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:06.460227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:06.461827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29db401-aa36-406e-b83b-312e51d7174d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:06.464017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db401-aa36-406e-b83b-312e51d7174d service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:06.464525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db401-aa36-406e-b83b-312e51d7174d service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:06.464984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db401-aa36-406e-b83b-312e51d7174d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:06.481024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29db401-aa36-406e-b83b-312e51d7174d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:06.484246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29db401-aa36-406e-b83b-312e51d7174d service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:06.516925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 905/1801] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:06.577908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7b319e24e2458bbbb8b54997a74d17', 'request_id': 'req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:06.588835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7b319e24e2458bbbb8b54997a74d17', 'request_id': 'req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:06.601464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7b319e24e2458bbbb8b54997a74d17', 'request_id': 'req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:06.620156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] The token cache is being invalidate because project 5a7b319e24e2458bbbb8b54997a74d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:06.620449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:06.623921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:06.626229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 897/1802] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:06 2022] DELETE /identity/v3/projects/5a7b319e24e2458bbbb8b54997a74d17 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:06.630447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29db401-aa36-406e-b83b-312e51d7174d service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:06.649916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29db401-aa36-406e-b83b-312e51d7174d service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:06.766478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:06.768544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:06.813193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:06.814078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:06.814367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:06.814786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] PATH_INFO: `/v3/users/dc03c67e94c94f58a103de90d1499ea9` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:06.816194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc03c67e94c94f58a103de90d1499ea9)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:06.818170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:06.910854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc03c67e94c94f58a103de90d1499ea9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:06.912782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc03c67e94c94f58a103de90d1499ea9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:06.933011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc03c67e94c94f58a103de90d1499ea9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:06.935305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc03c67e94c94f58a103de90d1499ea9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:06.939923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61222cfe-8d5b-4d5b-b4d1-ed77afa558fc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:06.947303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:06.948823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:06.949538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:06.950247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:06.954425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:06.961372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc03c67e94c94f58a103de90d1499ea9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.017475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 906/1803] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:06 2022] DELETE /identity/v3/users/dc03c67e94c94f58a103de90d1499ea9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:07.018653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:07.021091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:07.036023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:07.084618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:07.088555 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:07.106283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 898/1804] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:07.153767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:07.226837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f4af0-0ff3-4400-976c-ffd2092e4f60 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:07.242157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:07.243756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:07.244172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:07.244584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:07.248054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:07.267236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:07.269258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:07.291069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 907/1805] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:07.423365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:07.425306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:07.450868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2868a-4337-49e9-bcf9-33e7b622b111 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:07.490458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:07.492064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:07.640399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:07.641318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:07.641599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:07.641927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] PATH_INFO: `/v3/users/bb7ad3bffe79476b808a7015e5a2e70c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:07.645296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78215e02-ae47-49a0-9fcc-f4aa58da789f service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:07.646601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7ad3bffe79476b808a7015e5a2e70c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:07.648671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:07.660610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:07.662572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:07.662860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:07.663138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] PATH_INFO: `/v3/users/bca845ba324344a5ab42ad6bd6c227fa` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:07.664914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca845ba324344a5ab42ad6bd6c227fa)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:07.667905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:07.755699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7ad3bffe79476b808a7015e5a2e70c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.757746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7ad3bffe79476b808a7015e5a2e70c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.788114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca845ba324344a5ab42ad6bd6c227fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.788806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca845ba324344a5ab42ad6bd6c227fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.796111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7ad3bffe79476b808a7015e5a2e70c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.818321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca845ba324344a5ab42ad6bd6c227fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.818914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7ad3bffe79476b808a7015e5a2e70c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.819383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca845ba324344a5ab42ad6bd6c227fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.819695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4aeb5f67-5ee6-4666-b22b-c885f1013358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7ad3bffe79476b808a7015e5a2e70c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.841490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5875a38e-6aaa-452f-9c83-1bc362da37a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca845ba324344a5ab42ad6bd6c227fa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:07.844671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 899/1806] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:07 2022] DELETE /identity/v3/users/bb7ad3bffe79476b808a7015e5a2e70c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:07.846487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f1e6-6529-4820-bd3e-15f422651aab None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:07.846779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f1e6-6529-4820-bd3e-15f422651aab None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:07.847060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f1e6-6529-4820-bd3e-15f422651aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:07.895732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 908/1807] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:07 2022] DELETE /identity/v3/users/bca845ba324344a5ab42ad6bd6c227fa => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:07.900532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02fb3-6af1-4bff-8299-e650a2a582b9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:07.900702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a747f1e6-6529-4820-bd3e-15f422651aab None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:07.902727 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02fb3-6af1-4bff-8299-e650a2a582b9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:07.903187 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02fb3-6af1-4bff-8299-e650a2a582b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:07.905511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a747f1e6-6529-4820-bd3e-15f422651aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:07.953073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-85a02fb3-6af1-4bff-8299-e650a2a582b9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:07.954313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-85a02fb3-6af1-4bff-8299-e650a2a582b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:08.053113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:08.072191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:08.073360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 900/1808] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:08.076092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8a12-655c-498c-8c86-14a90cc6c40b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:08.076858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8a12-655c-498c-8c86-14a90cc6c40b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:08.078644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8a12-655c-498c-8c86-14a90cc6c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:08.108740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 909/1809] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:08.112449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02fb3-6af1-4bff-8299-e650a2a582b9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:08.116657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-85a02fb3-6af1-4bff-8299-e650a2a582b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:08.117557 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-182a8a12-655c-498c-8c86-14a90cc6c40b None None] MFA Rules not processed for user `bdf91133123a468fbb8297092fd22484`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:08.121386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-182a8a12-655c-498c-8c86-14a90cc6c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:08.261561 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 901/1810] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:08.264142 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8a12-655c-498c-8c86-14a90cc6c40b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:08.270832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-182a8a12-655c-498c-8c86-14a90cc6c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:08.280155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02fb3-6af1-4bff-8299-e650a2a582b9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:08.290078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b052c9-7183-4a81-8728-c68b6e0b434f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:08.291236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b052c9-7183-4a81-8728-c68b6e0b434f service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:08.291712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b052c9-7183-4a81-8728-c68b6e0b434f service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:08.292153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b052c9-7183-4a81-8728-c68b6e0b434f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:08.296216 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8a12-655c-498c-8c86-14a90cc6c40b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:08.302941 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48104804-073f-4269-b8ed-677f10cc4853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:08.304110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104804-073f-4269-b8ed-677f10cc4853 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:08.304303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104804-073f-4269-b8ed-677f10cc4853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:08.304638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48104804-073f-4269-b8ed-677f10cc4853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:08.322448 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48104804-073f-4269-b8ed-677f10cc4853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:08.322752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b052c9-7183-4a81-8728-c68b6e0b434f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:08.325061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48104804-073f-4269-b8ed-677f10cc4853 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:08.325839 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b052c9-7183-4a81-8728-c68b6e0b434f service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:08.344245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 902/1811] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:08.357210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 910/1812] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:09.170166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb652a-4d00-450c-a8ca-a6d66dae44f9 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:09.171360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb652a-4d00-450c-a8ca-a6d66dae44f9 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:09.171966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb652a-4d00-450c-a8ca-a6d66dae44f9 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:09.175784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 903/1813] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:28:09 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:28:09.197098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a423b-3f09-439e-87bb-e053815d6427 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:09.197628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a423b-3f09-439e-87bb-e053815d6427 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:09.197827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a423b-3f09-439e-87bb-e053815d6427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:09.230697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4d7a423b-3f09-439e-87bb-e053815d6427 None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:09.233608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4d7a423b-3f09-439e-87bb-e053815d6427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:09.418680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 911/1814] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:28:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:09.688406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb652a-4d00-450c-a8ca-a6d66dae44f9 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:09.690285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b3cb652a-4d00-450c-a8ca-a6d66dae44f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:09.709959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb652a-4d00-450c-a8ca-a6d66dae44f9 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:09.715129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:09.715800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:09.716089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:09.716372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] PATH_INFO: `/v3/projects/69853309a52248d79baa8ef724f974b4` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:09.717588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69853309a52248d79baa8ef724f974b4)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:09.719537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:09.792838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69853309a52248d79baa8ef724f974b4', 'request_id': 'req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:09.808011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69853309a52248d79baa8ef724f974b4', 'request_id': 'req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:09.820698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69853309a52248d79baa8ef724f974b4', 'request_id': 'req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:09.842306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] The token cache is being invalidate because project 69853309a52248d79baa8ef724f974b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:09.842641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:09.843927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:09.845675 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 904/1815] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:09 2022] DELETE /identity/v3/projects/69853309a52248d79baa8ef724f974b4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:09.851483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18215a-30e6-414d-8fbf-ae19c409b386 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:09.851957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18215a-30e6-414d-8fbf-ae19c409b386 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:09.852337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18215a-30e6-414d-8fbf-ae19c409b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:09.874683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9b18215a-30e6-414d-8fbf-ae19c409b386 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:09.876467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9b18215a-30e6-414d-8fbf-ae19c409b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:09.895981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:09.897702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:10.041396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 912/1816] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:10.062377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b15db-76fe-4413-a1b2-6cd5f1c19ec8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:10.062669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b15db-76fe-4413-a1b2-6cd5f1c19ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:10.062992 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b15db-76fe-4413-a1b2-6cd5f1c19ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:10.080089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3d63a-73c6-4fcc-8c14-95c0511e53a7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:10.093977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:10.095122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:10.095476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:10.095849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] PATH_INFO: `/v3/projects/be6223e151804870abaf8df28e999299` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:10.098077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6223e151804870abaf8df28e999299)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:10.100119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:10.112004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d95b15db-76fe-4413-a1b2-6cd5f1c19ec8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:10.113000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d95b15db-76fe-4413-a1b2-6cd5f1c19ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:10.127944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 913/1817] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:10.133829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b15db-76fe-4413-a1b2-6cd5f1c19ec8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:10.147907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b15db-76fe-4413-a1b2-6cd5f1c19ec8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:10.149152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:10.178850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69887f-cc8e-43ee-a0d0-fe73b143e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:10.179627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69887f-cc8e-43ee-a0d0-fe73b143e1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:10.180026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69887f-cc8e-43ee-a0d0-fe73b143e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:10.180313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69887f-cc8e-43ee-a0d0-fe73b143e1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:10.181723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69887f-cc8e-43ee-a0d0-fe73b143e1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:10.182042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69887f-cc8e-43ee-a0d0-fe73b143e1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:10.184619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69887f-cc8e-43ee-a0d0-fe73b143e1d6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:10.207178 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 914/1818] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:28:10.211234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69887f-cc8e-43ee-a0d0-fe73b143e1d6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:10.231473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:10.236039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6223e151804870abaf8df28e999299', 'request_id': 'req-81090522-6ef4-4b58-bd86-ce452d6a4497'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.276058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69887f-cc8e-43ee-a0d0-fe73b143e1d6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:10.288938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6223e151804870abaf8df28e999299', 'request_id': 'req-81090522-6ef4-4b58-bd86-ce452d6a4497'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.309256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6223e151804870abaf8df28e999299', 'request_id': 'req-81090522-6ef4-4b58-bd86-ce452d6a4497'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.348125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] The token cache is being invalidate because project be6223e151804870abaf8df28e999299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:10.349580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.350671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.357537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 905/1819] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:09 2022] DELETE /identity/v3/projects/be6223e151804870abaf8df28e999299 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:10.358766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:10.360511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:10.414540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce2a03-e34b-4f6d-a232-62a5a9c7c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:10.415350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce2a03-e34b-4f6d-a232-62a5a9c7c03f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:10.415653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce2a03-e34b-4f6d-a232-62a5a9c7c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:10.415958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce2a03-e34b-4f6d-a232-62a5a9c7c03f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:10.416797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce2a03-e34b-4f6d-a232-62a5a9c7c03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:10.418943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce2a03-e34b-4f6d-a232-62a5a9c7c03f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:10.475016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81090522-6ef4-4b58-bd86-ce452d6a4497 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:10.484683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:10.485526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 915/1820] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:10 2022] POST /identity/v3/projects => generated 376 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:10.486457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce2a03-e34b-4f6d-a232-62a5a9c7c03f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:10.486869 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:10.487395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:10.488137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] PATH_INFO: `/v3/projects/3638fb72e264460c80ab8469fd68f190` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:10.495566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-83ce2a03-e34b-4f6d-a232-62a5a9c7c03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:10.504284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3638fb72e264460c80ab8469fd68f190)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:10.508901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:10.629510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce2a03-e34b-4f6d-a232-62a5a9c7c03f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:10.634475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3638fb72e264460c80ab8469fd68f190', 'request_id': 'req-a1fe8e60-671d-49c0-9cba-0fb7957f3763'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.646316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3638fb72e264460c80ab8469fd68f190', 'request_id': 'req-a1fe8e60-671d-49c0-9cba-0fb7957f3763'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.673168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3638fb72e264460c80ab8469fd68f190', 'request_id': 'req-a1fe8e60-671d-49c0-9cba-0fb7957f3763'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.694939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] The token cache is being invalidate because project 3638fb72e264460c80ab8469fd68f190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:10.695257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.695997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.702637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 906/1821] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:10 2022] DELETE /identity/v3/projects/3638fb72e264460c80ab8469fd68f190 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:10.704642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:10.710534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:10.824956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:10.825871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:10.826160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:10.826437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] PATH_INFO: `/v3/users/28e9e6d1266648e3ac6a9fe719cd5107` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:10.828828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e9e6d1266648e3ac6a9fe719cd5107)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:10.836398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:10.867177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:10.955878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe8e60-671d-49c0-9cba-0fb7957f3763 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:10.963630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b9c44-176d-4463-a27a-6b3dfe544a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:10.964427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b9c44-176d-4463-a27a-6b3dfe544a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:10.964836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b9c44-176d-4463-a27a-6b3dfe544a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:10.965193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b9c44-176d-4463-a27a-6b3dfe544a90 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:10.966003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b9c44-176d-4463-a27a-6b3dfe544a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:10.966800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:10.970178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b9c44-176d-4463-a27a-6b3dfe544a90 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:10.990826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e9e6d1266648e3ac6a9fe719cd5107'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:10.993044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e9e6d1266648e3ac6a9fe719cd5107'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:11.004881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 907/1822] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:10 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:11.004881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b9c44-176d-4463-a27a-6b3dfe544a90 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:11.010103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3d2b9c44-176d-4463-a27a-6b3dfe544a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:11.021533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e9e6d1266648e3ac6a9fe719cd5107'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:11.024435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e9e6d1266648e3ac6a9fe719cd5107'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:11.043166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e9e6d1266648e3ac6a9fe719cd5107'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:11.125231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 916/1823] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:10 2022] DELETE /identity/v3/users/28e9e6d1266648e3ac6a9fe719cd5107 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:11.126627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:11.131134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:11.281579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90a28a-b70e-4863-975f-6318f0506d9a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:11.288491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:11.290323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:11.290926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:11.291660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] PATH_INFO: `/v3/users/e5270584d85d4550815b1c67da3e07e0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:11.293901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5270584d85d4550815b1c67da3e07e0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:11.296569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:11.311802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b9c44-176d-4463-a27a-6b3dfe544a90 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:11.423810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5270584d85d4550815b1c67da3e07e0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:11.425197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5270584d85d4550815b1c67da3e07e0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:11.440542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5270584d85d4550815b1c67da3e07e0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:11.442280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5270584d85d4550815b1c67da3e07e0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:11.457216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5270584d85d4550815b1c67da3e07e0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:11.486950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831ae3d-c073-4e58-a652-bb4dfbd6f65e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:11.487892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831ae3d-c073-4e58-a652-bb4dfbd6f65e service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:11.488113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831ae3d-c073-4e58-a652-bb4dfbd6f65e service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:11.488392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831ae3d-c073-4e58-a652-bb4dfbd6f65e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:11.493498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8831ae3d-c073-4e58-a652-bb4dfbd6f65e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:11.500969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 917/1824] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:11 2022] DELETE /identity/v3/users/e5270584d85d4550815b1c67da3e07e0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:11.502191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:11.507581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:11.520972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831ae3d-c073-4e58-a652-bb4dfbd6f65e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:11.524479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831ae3d-c073-4e58-a652-bb4dfbd6f65e service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:11.555446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 908/1825] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:11.622855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:11.690647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d235b-0fce-489a-a062-12e01d64d6a2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:11.696199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8d000-0329-45ab-9472-d4fcf9cb2335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:11.697439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8d000-0329-45ab-9472-d4fcf9cb2335 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:11.697815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8d000-0329-45ab-9472-d4fcf9cb2335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:11.697993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8d000-0329-45ab-9472-d4fcf9cb2335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:11.698834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8d000-0329-45ab-9472-d4fcf9cb2335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:11.700868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8d000-0329-45ab-9472-d4fcf9cb2335 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:11.714969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 918/1826] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:11 2022] GET /identity/v3/roles => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:11.719381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831ae3d-c073-4e58-a652-bb4dfbd6f65e service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:11.739956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831ae3d-c073-4e58-a652-bb4dfbd6f65e service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:11.751647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e874136-3115-428c-8746-c8b1fdb1a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:11.752514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e874136-3115-428c-8746-c8b1fdb1a9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:11.752854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e874136-3115-428c-8746-c8b1fdb1a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:11.753337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e874136-3115-428c-8746-c8b1fdb1a9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:11.754192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e874136-3115-428c-8746-c8b1fdb1a9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:11.759487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e874136-3115-428c-8746-c8b1fdb1a9b8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:11.782225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 909/1827] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:11 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:11.786860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8d000-0329-45ab-9472-d4fcf9cb2335 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:11.802978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8d000-0329-45ab-9472-d4fcf9cb2335 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:11.815280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6feb5-3c64-4728-8729-2e69b4a55582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:11.816250 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6feb5-3c64-4728-8729-2e69b4a55582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:11.816544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6feb5-3c64-4728-8729-2e69b4a55582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:11.816819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6feb5-3c64-4728-8729-2e69b4a55582 admin admin] PATH_INFO: `/v3/projects/2aecf83cde444405a2fa82a5cc290cd6/users/055ef29043e34b85a23af6b575783853/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:11.849405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6feb5-3c64-4728-8729-2e69b4a55582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aecf83cde444405a2fa82a5cc290cd6, user_id=055ef29043e34b85a23af6b575783853, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:11.856100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6feb5-3c64-4728-8729-2e69b4a55582 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:11.897182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 919/1828] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:11 2022] PUT /identity/v3/projects/2aecf83cde444405a2fa82a5cc290cd6/users/055ef29043e34b85a23af6b575783853/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:11.919827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee020ed-a3d7-485c-af28-9380830b19a1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:11.935676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee020ed-a3d7-485c-af28-9380830b19a1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:11.936084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee020ed-a3d7-485c-af28-9380830b19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:12.018839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9ee020ed-a3d7-485c-af28-9380830b19a1 None None] MFA Rules not processed for user `055ef29043e34b85a23af6b575783853`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:12.026463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9ee020ed-a3d7-485c-af28-9380830b19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:12.144629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:12.238866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 910/1829] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:12.243983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6feb5-3c64-4728-8729-2e69b4a55582 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:12.394570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6feb5-3c64-4728-8729-2e69b4a55582 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:12.400365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af3d85-d968-4d10-b31f-ad6c95ab6705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:12.401042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3d85-d968-4d10-b31f-ad6c95ab6705 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:12.401323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3d85-d968-4d10-b31f-ad6c95ab6705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:12.402100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af3d85-d968-4d10-b31f-ad6c95ab6705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:12.402992 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af3d85-d968-4d10-b31f-ad6c95ab6705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:12.404982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af3d85-d968-4d10-b31f-ad6c95ab6705 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:12.458775 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 920/1830] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:12 2022] POST /identity/v3/projects => generated 376 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:12.462653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee020ed-a3d7-485c-af28-9380830b19a1 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:12.479761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee020ed-a3d7-485c-af28-9380830b19a1 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:12.649648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e8c84-28a4-47b7-8388-03b92fa13c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:12.651282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e8c84-28a4-47b7-8388-03b92fa13c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:12.651770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e8c84-28a4-47b7-8388-03b92fa13c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:12.652092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e8c84-28a4-47b7-8388-03b92fa13c1e admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:12.653026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e8c84-28a4-47b7-8388-03b92fa13c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:12.656157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e8c84-28a4-47b7-8388-03b92fa13c1e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:12.687654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 911/1831] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:12 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:12.689100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af3d85-d968-4d10-b31f-ad6c95ab6705 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:12.708202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af3d85-d968-4d10-b31f-ad6c95ab6705 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:12.714661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6661-7333-4bb2-8d8b-1e2634903b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:12.715237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6661-7333-4bb2-8d8b-1e2634903b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:12.715666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6661-7333-4bb2-8d8b-1e2634903b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:12.716062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f6661-7333-4bb2-8d8b-1e2634903b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:12.717741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f6661-7333-4bb2-8d8b-1e2634903b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:12.737421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f6661-7333-4bb2-8d8b-1e2634903b95 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:12.793109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 921/1832] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:12 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:12.795732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e8c84-28a4-47b7-8388-03b92fa13c1e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:12.795943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6661-7333-4bb2-8d8b-1e2634903b95 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:12.801238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e96e8c84-28a4-47b7-8388-03b92fa13c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:12.817839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e8c84-28a4-47b7-8388-03b92fa13c1e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:12.820316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f6661-7333-4bb2-8d8b-1e2634903b95 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:12.832328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:12.837814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:12.838834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:12.840474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] PATH_INFO: `/v3/projects/8e7104cfc00d48418bc9ba76ae6369de` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:12.843768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7104cfc00d48418bc9ba76ae6369de)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:12.844167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b6239-d5d3-45c7-b166-cd60c6e4e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:12.845259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b6239-d5d3-45c7-b166-cd60c6e4e831 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:12.849187 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b6239-d5d3-45c7-b166-cd60c6e4e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:12.850165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b6239-d5d3-45c7-b166-cd60c6e4e831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:12.853837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b6239-d5d3-45c7-b166-cd60c6e4e831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:12.854585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:12.860710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b6239-d5d3-45c7-b166-cd60c6e4e831 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:12.927999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 922/1833] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:12 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:12.951472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b6239-d5d3-45c7-b166-cd60c6e4e831 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.000357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b6239-d5d3-45c7-b166-cd60c6e4e831 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.007704 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d9ddb-d672-4326-8240-09e9881d346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.010333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d9ddb-d672-4326-8240-09e9881d346d admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.010827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d9ddb-d672-4326-8240-09e9881d346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.011255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d9ddb-d672-4326-8240-09e9881d346d admin admin] PATH_INFO: `/v3/projects/3ef6cd458e8f4789a209e350bebce032/users/01cc4ca49fcc41d799e2587fc7cd468d/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.079961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d9ddb-d672-4326-8240-09e9881d346d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef6cd458e8f4789a209e350bebce032, user_id=01cc4ca49fcc41d799e2587fc7cd468d, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.086079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d9ddb-d672-4326-8240-09e9881d346d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.128573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 923/1834] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:12 2022] PUT /identity/v3/projects/3ef6cd458e8f4789a209e350bebce032/users/01cc4ca49fcc41d799e2587fc7cd468d/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:13.136426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d9ddb-d672-4326-8240-09e9881d346d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.138535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7104cfc00d48418bc9ba76ae6369de', 'request_id': 'req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.154188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-383d9ddb-d672-4326-8240-09e9881d346d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:13.181339 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7104cfc00d48418bc9ba76ae6369de', 'request_id': 'req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.210206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7104cfc00d48418bc9ba76ae6369de', 'request_id': 'req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.242584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] The token cache is being invalidate because project 8e7104cfc00d48418bc9ba76ae6369de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:13.243168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.244878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1c0a3012-1bcc-4b94-8c92-7e37fa3c59f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.252700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 912/1835] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:12 2022] DELETE /identity/v3/projects/8e7104cfc00d48418bc9ba76ae6369de => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:13.252700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a4599-ef32-4f86-9b3d-df1d39c4253d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.252700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a4599-ef32-4f86-9b3d-df1d39c4253d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.254815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a4599-ef32-4f86-9b3d-df1d39c4253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.295640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:13.318963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d9ddb-d672-4326-8240-09e9881d346d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.320481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a25a4599-ef32-4f86-9b3d-df1d39c4253d None None] MFA Rules not processed for user `01cc4ca49fcc41d799e2587fc7cd468d`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:13.322474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a25a4599-ef32-4f86-9b3d-df1d39c4253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:13.334246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.335854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.336969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.337167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] PATH_INFO: `/v3/projects/397e779a77f143ab837ac0328131143d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.339133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=397e779a77f143ab837ac0328131143d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.341751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.356523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:13.415675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397e779a77f143ab837ac0328131143d', 'request_id': 'req-49350aaf-b232-43a5-a653-aa38e8fe4d3e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.420824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 913/1836] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:13.421717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a4599-ef32-4f86-9b3d-df1d39c4253d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.423146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a25a4599-ef32-4f86-9b3d-df1d39c4253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:13.425345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397e779a77f143ab837ac0328131143d', 'request_id': 'req-49350aaf-b232-43a5-a653-aa38e8fe4d3e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.435925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397e779a77f143ab837ac0328131143d', 'request_id': 'req-49350aaf-b232-43a5-a653-aa38e8fe4d3e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.449806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] The token cache is being invalidate because project 397e779a77f143ab837ac0328131143d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:13.450067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a4599-ef32-4f86-9b3d-df1d39c4253d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.450226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.450772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.452625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 924/1837] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:13 2022] DELETE /identity/v3/projects/397e779a77f143ab837ac0328131143d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:13.456797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.458247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:13.529321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.530222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.530509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.530827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] PATH_INFO: `/v3/users/c38cef1067154606993ef444f6900750` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.532570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38cef1067154606993ef444f6900750)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.535287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.554543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49350aaf-b232-43a5-a653-aa38e8fe4d3e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.559400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b1a8-4145-4793-be4a-5df929e10083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.560118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b1a8-4145-4793-be4a-5df929e10083 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.560405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b1a8-4145-4793-be4a-5df929e10083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.560684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b1a8-4145-4793-be4a-5df929e10083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.567856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094b1a8-4145-4793-be4a-5df929e10083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.567856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094b1a8-4145-4793-be4a-5df929e10083 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.593988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 925/1838] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:13 2022] POST /identity/v3/projects => generated 376 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:13.596399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38cef1067154606993ef444f6900750'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.596565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f4a4-c034-4e0c-b19c-fa846f805273 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.596890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f4a4-c034-4e0c-b19c-fa846f805273 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.597166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f4a4-c034-4e0c-b19c-fa846f805273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.597614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38cef1067154606993ef444f6900750'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.613091 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38cef1067154606993ef444f6900750'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.617081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d184f4a4-c034-4e0c-b19c-fa846f805273 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:13.618307 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d184f4a4-c034-4e0c-b19c-fa846f805273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:13.620347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38cef1067154606993ef444f6900750'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.621068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38cef1067154606993ef444f6900750'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:13.635845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 914/1839] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:13 2022] DELETE /identity/v3/users/c38cef1067154606993ef444f6900750 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:13.636695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.638162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:13.710620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:13.711640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 926/1840] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:13.720360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f7e5c-ef91-4216-b8bf-9e85de787fb0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.721875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f7e5c-ef91-4216-b8bf-9e85de787fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.722422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f7e5c-ef91-4216-b8bf-9e85de787fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.733931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8da7f-c51b-4741-af24-d976afc1aa2a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.734815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:13.748681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d5f0d-fd13-4fbe-b236-6abf81884005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.749324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d5f0d-fd13-4fbe-b236-6abf81884005 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.749765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d5f0d-fd13-4fbe-b236-6abf81884005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.750041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d5f0d-fd13-4fbe-b236-6abf81884005 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.750757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d5f0d-fd13-4fbe-b236-6abf81884005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.752736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d5f0d-fd13-4fbe-b236-6abf81884005 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.754932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0a3f7e5c-ef91-4216-b8bf-9e85de787fb0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:13.756458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0a3f7e5c-ef91-4216-b8bf-9e85de787fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:13.773418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 927/1841] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:13.777381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f7e5c-ef91-4216-b8bf-9e85de787fb0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.784027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 915/1842] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:13 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:13.788494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d5f0d-fd13-4fbe-b236-6abf81884005 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.791314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f7e5c-ef91-4216-b8bf-9e85de787fb0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.797383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f92e6-0976-4bd1-8952-9a0d08f8ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.798104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f92e6-0976-4bd1-8952-9a0d08f8ee42 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.798572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f92e6-0976-4bd1-8952-9a0d08f8ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.798877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f92e6-0976-4bd1-8952-9a0d08f8ee42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.800630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f92e6-0976-4bd1-8952-9a0d08f8ee42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:13.800942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f92e6-0976-4bd1-8952-9a0d08f8ee42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.803125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f92e6-0976-4bd1-8952-9a0d08f8ee42 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.807973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d5f0d-fd13-4fbe-b236-6abf81884005 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.814692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd7806-6e83-49d4-9f7b-f1c00e3375e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.815246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd7806-6e83-49d4-9f7b-f1c00e3375e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.815525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd7806-6e83-49d4-9f7b-f1c00e3375e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.815834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd7806-6e83-49d4-9f7b-f1c00e3375e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.816557 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd7806-6e83-49d4-9f7b-f1c00e3375e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.818149 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd7806-6e83-49d4-9f7b-f1c00e3375e2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.823027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 928/1843] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:28:13.824383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f92e6-0976-4bd1-8952-9a0d08f8ee42 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.837560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 916/1844] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:13 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:13.837761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f92e6-0976-4bd1-8952-9a0d08f8ee42 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.839370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd7806-6e83-49d4-9f7b-f1c00e3375e2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.845759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9886c-7e6a-45cb-a6dc-c7e04220b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.847408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9886c-7e6a-45cb-a6dc-c7e04220b052 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.847795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9886c-7e6a-45cb-a6dc-c7e04220b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.848236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9886c-7e6a-45cb-a6dc-c7e04220b052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.849355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9886c-7e6a-45cb-a6dc-c7e04220b052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.859786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd7806-6e83-49d4-9f7b-f1c00e3375e2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.862886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9886c-7e6a-45cb-a6dc-c7e04220b052 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.867461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0577e3-a64c-4611-8bae-5e7ba8edbb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.868640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0577e3-a64c-4611-8bae-5e7ba8edbb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.868834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0577e3-a64c-4611-8bae-5e7ba8edbb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.869189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0577e3-a64c-4611-8bae-5e7ba8edbb18 admin admin] PATH_INFO: `/v3/projects/9a991db725de47e09129f544c3d2ed0f/users/e0cf8ccd507e466eb66a63f5062ade95/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.887126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0577e3-a64c-4611-8bae-5e7ba8edbb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a991db725de47e09129f544c3d2ed0f, user_id=e0cf8ccd507e466eb66a63f5062ade95, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.890267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0577e3-a64c-4611-8bae-5e7ba8edbb18 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.913486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 929/1846] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:13 2022] POST /identity/v3/projects => generated 370 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:13.913672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 917/1846] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:13 2022] PUT /identity/v3/projects/9a991db725de47e09129f544c3d2ed0f/users/e0cf8ccd507e466eb66a63f5062ade95/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:13.914207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9886c-7e6a-45cb-a6dc-c7e04220b052 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.915245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0577e3-a64c-4611-8bae-5e7ba8edbb18 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:13.985002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9886c-7e6a-45cb-a6dc-c7e04220b052 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:13.990196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd037f45-5ffe-429a-b4de-79b73114ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:13.990874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd037f45-5ffe-429a-b4de-79b73114ed22 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:13.991154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd037f45-5ffe-429a-b4de-79b73114ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:13.991641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd037f45-5ffe-429a-b4de-79b73114ed22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:13.992220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd037f45-5ffe-429a-b4de-79b73114ed22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:13.994339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd037f45-5ffe-429a-b4de-79b73114ed22 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:13.998036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0577e3-a64c-4611-8bae-5e7ba8edbb18 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.003739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994b476-fc6d-4646-8b17-49207798f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.004427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994b476-fc6d-4646-8b17-49207798f2dd admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.004712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994b476-fc6d-4646-8b17-49207798f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.005519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994b476-fc6d-4646-8b17-49207798f2dd admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.005856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994b476-fc6d-4646-8b17-49207798f2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.006117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 930/1847] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:13 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:14.009660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994b476-fc6d-4646-8b17-49207798f2dd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.011880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd037f45-5ffe-429a-b4de-79b73114ed22 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:14.024622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd037f45-5ffe-429a-b4de-79b73114ed22 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.031137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c857462-5f5b-4500-aa49-ab53915200d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.032511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857462-5f5b-4500-aa49-ab53915200d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.032903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857462-5f5b-4500-aa49-ab53915200d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.033727 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c857462-5f5b-4500-aa49-ab53915200d5 admin admin] PATH_INFO: `/v3/projects/9a991db725de47e09129f544c3d2ed0f/users/e0cf8ccd507e466eb66a63f5062ade95/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.037411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c857462-5f5b-4500-aa49-ab53915200d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a991db725de47e09129f544c3d2ed0f, user_id=e0cf8ccd507e466eb66a63f5062ade95, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.040890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c857462-5f5b-4500-aa49-ab53915200d5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.041032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 918/1848] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:13 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:14.045946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994b476-fc6d-4646-8b17-49207798f2dd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:14.064225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 931/1849] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:14 2022] PUT /identity/v3/projects/9a991db725de47e09129f544c3d2ed0f/users/e0cf8ccd507e466eb66a63f5062ade95/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:14.064952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994b476-fc6d-4646-8b17-49207798f2dd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.067158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434e865-885f-4b8f-9e17-fb3c6ad082af None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.068043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434e865-885f-4b8f-9e17-fb3c6ad082af None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.068450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434e865-885f-4b8f-9e17-fb3c6ad082af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.102942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2434e865-885f-4b8f-9e17-fb3c6ad082af None None] MFA Rules not processed for user `e0cf8ccd507e466eb66a63f5062ade95`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:14.104272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2434e865-885f-4b8f-9e17-fb3c6ad082af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:14.165700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862def5d-1c4a-40c0-9f12-4d197dadc417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.166599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862def5d-1c4a-40c0-9f12-4d197dadc417 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.166952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862def5d-1c4a-40c0-9f12-4d197dadc417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.167321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862def5d-1c4a-40c0-9f12-4d197dadc417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.168168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862def5d-1c4a-40c0-9f12-4d197dadc417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.169865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862def5d-1c4a-40c0-9f12-4d197dadc417 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.184959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 919/1850] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:14 2022] GET /identity/v3/roles => generated 1427 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:14.185833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862def5d-1c4a-40c0-9f12-4d197dadc417 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:14.188832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-862def5d-1c4a-40c0-9f12-4d197dadc417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:14.202621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862def5d-1c4a-40c0-9f12-4d197dadc417 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.209579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 932/1851] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:14.209579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434e865-885f-4b8f-9e17-fb3c6ad082af None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:14.213886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.214880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.215237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.215636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] PATH_INFO: `/v3/projects/48bde50702ce4be9b7f96923eb4efea4` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.216995 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48bde50702ce4be9b7f96923eb4efea4)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.219254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.222414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434e865-885f-4b8f-9e17-fb3c6ad082af None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.227260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d212868-e347-4e7c-bf31-900bf48cfc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.228063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d212868-e347-4e7c-bf31-900bf48cfc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.228421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d212868-e347-4e7c-bf31-900bf48cfc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.228774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d212868-e347-4e7c-bf31-900bf48cfc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.229589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d212868-e347-4e7c-bf31-900bf48cfc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.231606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d212868-e347-4e7c-bf31-900bf48cfc8a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.245172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 933/1852] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:14 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:14.245172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d212868-e347-4e7c-bf31-900bf48cfc8a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:14.249381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2d212868-e347-4e7c-bf31-900bf48cfc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:14.264541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:14.276346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:14.324008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d212868-e347-4e7c-bf31-900bf48cfc8a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.330058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bde50702ce4be9b7f96923eb4efea4', 'request_id': 'req-729b60b2-40b7-431b-9f69-86ddb8a35542'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:14.338107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bde50702ce4be9b7f96923eb4efea4', 'request_id': 'req-729b60b2-40b7-431b-9f69-86ddb8a35542'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:14.350151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bde50702ce4be9b7f96923eb4efea4', 'request_id': 'req-729b60b2-40b7-431b-9f69-86ddb8a35542'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:14.373404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] The token cache is being invalidate because project 48bde50702ce4be9b7f96923eb4efea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:14.373865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:14.374899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:14.377067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 920/1853] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:14 2022] DELETE /identity/v3/projects/48bde50702ce4be9b7f96923eb4efea4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:14.378718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:14.380424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:14.420082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5219c-61fb-4c79-a6fc-3be7354a51ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.421264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5219c-61fb-4c79-a6fc-3be7354a51ad service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.421750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5219c-61fb-4c79-a6fc-3be7354a51ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.422268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5219c-61fb-4c79-a6fc-3be7354a51ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.426713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8ab5219c-61fb-4c79-a6fc-3be7354a51ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:14.498363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b60b2-40b7-431b-9f69-86ddb8a35542 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.506487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34d91-afa8-4408-83fb-269f18504d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.508351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34d91-afa8-4408-83fb-269f18504d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.509106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34d91-afa8-4408-83fb-269f18504d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.509612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34d91-afa8-4408-83fb-269f18504d87 admin admin] PATH_INFO: `/v3/projects/85364e40fd2b48afb4bafe2b7913ba87/users/b95c59461a3f428884b22a014a6c785e/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.537765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34d91-afa8-4408-83fb-269f18504d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85364e40fd2b48afb4bafe2b7913ba87, user_id=b95c59461a3f428884b22a014a6c785e, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.542357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee34d91-afa8-4408-83fb-269f18504d87 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.572251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5219c-61fb-4c79-a6fc-3be7354a51ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.574005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 921/1854] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:14 2022] PUT /identity/v3/projects/85364e40fd2b48afb4bafe2b7913ba87/users/b95c59461a3f428884b22a014a6c785e/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:14.574852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5219c-61fb-4c79-a6fc-3be7354a51ad service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.591433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b20b-6269-4016-ae87-1e5b34b48873 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.595640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b20b-6269-4016-ae87-1e5b34b48873 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.597192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b20b-6269-4016-ae87-1e5b34b48873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.622831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 934/1855] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:14.626819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a2d30-b5c7-4605-a286-53c32bec9383 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.628664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a2d30-b5c7-4605-a286-53c32bec9383 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.630034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a2d30-b5c7-4605-a286-53c32bec9383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.632429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4167b20b-6269-4016-ae87-1e5b34b48873 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:14.633897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4167b20b-6269-4016-ae87-1e5b34b48873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:14.705101 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1d5a2d30-b5c7-4605-a286-53c32bec9383 None None] MFA Rules not processed for user `b95c59461a3f428884b22a014a6c785e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:14.709707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1d5a2d30-b5c7-4605-a286-53c32bec9383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:14.723709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 922/1856] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:14.726150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba495e-d933-4a1c-b0f1-2f9105a51062 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.726447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba495e-d933-4a1c-b0f1-2f9105a51062 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.726733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba495e-d933-4a1c-b0f1-2f9105a51062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.756143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a3ba495e-d933-4a1c-b0f1-2f9105a51062 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:14.757385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a3ba495e-d933-4a1c-b0f1-2f9105a51062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:14.774876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 923/1857] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:14.777361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba495e-d933-4a1c-b0f1-2f9105a51062 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:14.801405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba495e-d933-4a1c-b0f1-2f9105a51062 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.815249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07f6ef-d635-4d4a-b1e3-776820285a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.816611 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07f6ef-d635-4d4a-b1e3-776820285a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.817182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07f6ef-d635-4d4a-b1e3-776820285a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.817474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07f6ef-d635-4d4a-b1e3-776820285a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.818339 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07f6ef-d635-4d4a-b1e3-776820285a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:14.818652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07f6ef-d635-4d4a-b1e3-776820285a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.823074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07f6ef-d635-4d4a-b1e3-776820285a89 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.858615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 924/1858] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:14.860141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07f6ef-d635-4d4a-b1e3-776820285a89 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:14.872999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 935/1859] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:14.879190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a2d30-b5c7-4605-a286-53c32bec9383 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:14.887953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07f6ef-d635-4d4a-b1e3-776820285a89 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.905058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a2d30-b5c7-4605-a286-53c32bec9383 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:14.919238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b12ef-8832-4bbc-9d0b-630e7ff925ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.919958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b12ef-8832-4bbc-9d0b-630e7ff925ec admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.920250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b12ef-8832-4bbc-9d0b-630e7ff925ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.920536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b12ef-8832-4bbc-9d0b-630e7ff925ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.921244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b12ef-8832-4bbc-9d0b-630e7ff925ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.922255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f5dd-3f77-4f96-a1a2-b36642ceb3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:14.922931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f5dd-3f77-4f96-a1a2-b36642ceb3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:14.923218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f5dd-3f77-4f96-a1a2-b36642ceb3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:14.923337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b12ef-8832-4bbc-9d0b-630e7ff925ec admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.923502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f5dd-3f77-4f96-a1a2-b36642ceb3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:14.924505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f5dd-3f77-4f96-a1a2-b36642ceb3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:14.928347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f5dd-3f77-4f96-a1a2-b36642ceb3b6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:14.937330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:14.973407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:14.976665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 925/1860] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:14 2022] POST /identity/v3/projects => generated 390 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:14.982567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b12ef-8832-4bbc-9d0b-630e7ff925ec admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.005407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 936/1861] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:14 2022] POST /identity/v3/projects => generated 370 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:15.011777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f5dd-3f77-4f96-a1a2-b36642ceb3b6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.152988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b12ef-8832-4bbc-9d0b-630e7ff925ec admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:15.214640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f5dd-3f77-4f96-a1a2-b36642ceb3b6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:15.225395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d3961-b2eb-49fb-b05d-29ab763c3c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:15.226143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d3961-b2eb-49fb-b05d-29ab763c3c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.226451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d3961-b2eb-49fb-b05d-29ab763c3c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.226716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d3961-b2eb-49fb-b05d-29ab763c3c4a admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.227431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d3961-b2eb-49fb-b05d-29ab763c3c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:15.230496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d3961-b2eb-49fb-b05d-29ab763c3c4a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:15.272491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 937/1862] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:15 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:15.276478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d3961-b2eb-49fb-b05d-29ab763c3c4a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.309350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d3961-b2eb-49fb-b05d-29ab763c3c4a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:15.319222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e7dd2-ce5f-4894-9fec-e7e8affd2c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:15.320942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e7dd2-ce5f-4894-9fec-e7e8affd2c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.320942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e7dd2-ce5f-4894-9fec-e7e8affd2c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.321181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e7dd2-ce5f-4894-9fec-e7e8affd2c00 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.321893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e7dd2-ce5f-4894-9fec-e7e8affd2c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:15.325995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8208a-3dc1-4720-9c84-2fa8757258de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:15.326682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8208a-3dc1-4720-9c84-2fa8757258de admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.326967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8208a-3dc1-4720-9c84-2fa8757258de admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.327245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8208a-3dc1-4720-9c84-2fa8757258de admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.328720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8208a-3dc1-4720-9c84-2fa8757258de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:15.330372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8208a-3dc1-4720-9c84-2fa8757258de admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:15.336002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e7dd2-ce5f-4894-9fec-e7e8affd2c00 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:15.364044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 938/1863] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:15 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:15.368569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8208a-3dc1-4720-9c84-2fa8757258de admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.382907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 926/1864] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:14 2022] POST /identity/v3/users => generated 296 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:15.386248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8208a-3dc1-4720-9c84-2fa8757258de admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:15.387149 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e7dd2-ce5f-4894-9fec-e7e8affd2c00 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.394876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718d13-276f-4512-b98e-206902a18bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:15.396066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718d13-276f-4512-b98e-206902a18bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.396517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718d13-276f-4512-b98e-206902a18bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.396957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718d13-276f-4512-b98e-206902a18bf6 admin admin] PATH_INFO: `/v3/projects/863ba73d8f04408bb6467918c3c0c981/users/e7bb277612e94347b5807dd071bbf9e1/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.413532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e7dd2-ce5f-4894-9fec-e7e8affd2c00 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:15.419924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de3c8-e197-4ad9-b998-a49fa9b5e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:15.420758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de3c8-e197-4ad9-b998-a49fa9b5e127 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.421156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de3c8-e197-4ad9-b998-a49fa9b5e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.421458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de3c8-e197-4ad9-b998-a49fa9b5e127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.422207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17de3c8-e197-4ad9-b998-a49fa9b5e127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:15.425316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17de3c8-e197-4ad9-b998-a49fa9b5e127 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:15.425996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3718d13-276f-4512-b98e-206902a18bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863ba73d8f04408bb6467918c3c0c981, user_id=e7bb277612e94347b5807dd071bbf9e1, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:15.429793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3718d13-276f-4512-b98e-206902a18bf6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:15.439175 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 927/1865] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:15 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:15.444051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de3c8-e197-4ad9-b998-a49fa9b5e127 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.460642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 939/1866] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:15 2022] PUT /identity/v3/projects/863ba73d8f04408bb6467918c3c0c981/users/e7bb277612e94347b5807dd071bbf9e1/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:15.471426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718d13-276f-4512-b98e-206902a18bf6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.492888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de3c8-e197-4ad9-b998-a49fa9b5e127 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:15.568788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718d13-276f-4512-b98e-206902a18bf6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:15.576542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269923fc-37b0-4cd9-b978-24378b781357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:15.577602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269923fc-37b0-4cd9-b978-24378b781357 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.578112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269923fc-37b0-4cd9-b978-24378b781357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.578633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269923fc-37b0-4cd9-b978-24378b781357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.578915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3462b92-c391-44af-8067-aedaa41f0abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:15.579865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3462b92-c391-44af-8067-aedaa41f0abd admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.580183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3462b92-c391-44af-8067-aedaa41f0abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.580590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3462b92-c391-44af-8067-aedaa41f0abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.581137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269923fc-37b0-4cd9-b978-24378b781357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:15.581339 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3462b92-c391-44af-8067-aedaa41f0abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:15.583315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269923fc-37b0-4cd9-b978-24378b781357 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:15.585446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3462b92-c391-44af-8067-aedaa41f0abd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:15.603040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 928/1867] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:15 2022] GET /identity/v3/roles => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:15.606729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 940/1868] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:15 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:15.608145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3462b92-c391-44af-8067-aedaa41f0abd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.608298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269923fc-37b0-4cd9-b978-24378b781357 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.622738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269923fc-37b0-4cd9-b978-24378b781357 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:15.632715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3462b92-c391-44af-8067-aedaa41f0abd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:15.634131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355302bb-5bfc-4446-9efb-a9f4e9b7f13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:15.635052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355302bb-5bfc-4446-9efb-a9f4e9b7f13f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.635341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355302bb-5bfc-4446-9efb-a9f4e9b7f13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.635699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355302bb-5bfc-4446-9efb-a9f4e9b7f13f admin admin] PATH_INFO: `/v3/projects/863ba73d8f04408bb6467918c3c0c981/users/e7bb277612e94347b5807dd071bbf9e1/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.639044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d928-804d-478b-8e6d-ac6038a39c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:15.640891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d928-804d-478b-8e6d-ac6038a39c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.641187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d928-804d-478b-8e6d-ac6038a39c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.641414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355302bb-5bfc-4446-9efb-a9f4e9b7f13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=863ba73d8f04408bb6467918c3c0c981, user_id=e7bb277612e94347b5807dd071bbf9e1, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:15.641518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d928-804d-478b-8e6d-ac6038a39c31 admin admin] PATH_INFO: `/v3/projects/532ecc0218be4c99a2ca497017660d72/users/2032a29929c44dff9ceaa0e8bbae66ce/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.644798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355302bb-5bfc-4446-9efb-a9f4e9b7f13f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:15.659713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:15.661506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 941/1869] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:15 2022] PUT /identity/v3/projects/863ba73d8f04408bb6467918c3c0c981/users/e7bb277612e94347b5807dd071bbf9e1/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:15.666221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d928-804d-478b-8e6d-ac6038a39c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532ecc0218be4c99a2ca497017660d72, user_id=2032a29929c44dff9ceaa0e8bbae66ce, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:15.670701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d928-804d-478b-8e6d-ac6038a39c31 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:15.672145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed188bb-0535-4cdc-8993-4c354dc1b498 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.672438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed188bb-0535-4cdc-8993-4c354dc1b498 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.672722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed188bb-0535-4cdc-8993-4c354dc1b498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.696400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 929/1870] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:15 2022] PUT /identity/v3/projects/532ecc0218be4c99a2ca497017660d72/users/2032a29929c44dff9ceaa0e8bbae66ce/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:15.708098 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881503c-f828-42f0-b75d-109cf4a52733 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:15.708445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881503c-f828-42f0-b75d-109cf4a52733 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:15.708657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881503c-f828-42f0-b75d-109cf4a52733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:15.727193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1ed188bb-0535-4cdc-8993-4c354dc1b498 None None] MFA Rules not processed for user `e7bb277612e94347b5807dd071bbf9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:15.728904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1ed188bb-0535-4cdc-8993-4c354dc1b498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:15.799858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:15.801197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0881503c-f828-42f0-b75d-109cf4a52733 None None] MFA Rules not processed for user `2032a29929c44dff9ceaa0e8bbae66ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:15.802778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0881503c-f828-42f0-b75d-109cf4a52733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:15.889766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 942/1871] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:15.904708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed188bb-0535-4cdc-8993-4c354dc1b498 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:15.904708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1ed188bb-0535-4cdc-8993-4c354dc1b498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:15.955544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 930/1872] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:15.956734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881503c-f828-42f0-b75d-109cf4a52733 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:16.031701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed188bb-0535-4cdc-8993-4c354dc1b498 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:16.040996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f65ab-8d7b-4f3e-b242-5cd57ab4965a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:16.041682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f65ab-8d7b-4f3e-b242-5cd57ab4965a service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:16.041963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f65ab-8d7b-4f3e-b242-5cd57ab4965a service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:16.042238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f65ab-8d7b-4f3e-b242-5cd57ab4965a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:16.068430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f65ab-8d7b-4f3e-b242-5cd57ab4965a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:16.070060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f65ab-8d7b-4f3e-b242-5cd57ab4965a service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:16.086297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 943/1873] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:16.092937 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881503c-f828-42f0-b75d-109cf4a52733 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:16.101164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba6f43-5402-4eed-9102-6c8db4eb221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:16.102410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba6f43-5402-4eed-9102-6c8db4eb221e admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:16.102928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba6f43-5402-4eed-9102-6c8db4eb221e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:16.104093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba6f43-5402-4eed-9102-6c8db4eb221e admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:16.108516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba6f43-5402-4eed-9102-6c8db4eb221e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:16.115218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba6f43-5402-4eed-9102-6c8db4eb221e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:16.178595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 931/1874] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:15 2022] POST /identity/v3/projects => generated 390 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:16.181297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f65ab-8d7b-4f3e-b242-5cd57ab4965a service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:16.197875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f65ab-8d7b-4f3e-b242-5cd57ab4965a service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:16.287366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ffea0-f1b6-40d7-b476-8e8b216f4bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:16.288769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ffea0-f1b6-40d7-b476-8e8b216f4bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:16.289044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ffea0-f1b6-40d7-b476-8e8b216f4bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:16.289797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ffea0-f1b6-40d7-b476-8e8b216f4bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:16.291796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ffea0-f1b6-40d7-b476-8e8b216f4bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:16.294136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ffea0-f1b6-40d7-b476-8e8b216f4bf1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:16.351109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 944/1875] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:16 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:16.352095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba6f43-5402-4eed-9102-6c8db4eb221e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:16.376782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba6f43-5402-4eed-9102-6c8db4eb221e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:16.403627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850ea6a-2b26-4a5b-9120-e0b1208d2eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:16.414208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850ea6a-2b26-4a5b-9120-e0b1208d2eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:16.414740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850ea6a-2b26-4a5b-9120-e0b1208d2eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:16.415192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850ea6a-2b26-4a5b-9120-e0b1208d2eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:16.416150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850ea6a-2b26-4a5b-9120-e0b1208d2eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:16.419056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850ea6a-2b26-4a5b-9120-e0b1208d2eb5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:16.443922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 932/1876] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:16 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:16.452594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ffea0-f1b6-40d7-b476-8e8b216f4bf1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:16.468658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ffea0-f1b6-40d7-b476-8e8b216f4bf1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:16.489925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3063ce8-ecde-4e29-b949-eafbeb307675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:16.491617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3063ce8-ecde-4e29-b949-eafbeb307675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:16.491617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3063ce8-ecde-4e29-b949-eafbeb307675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:16.491617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3063ce8-ecde-4e29-b949-eafbeb307675 admin admin] PATH_INFO: `/v3/projects/f35667f7c48c4289bbd75063db6bc6a8/users/04316a1ae05044c48f003ab2872688f8/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:16.536611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3063ce8-ecde-4e29-b949-eafbeb307675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35667f7c48c4289bbd75063db6bc6a8, user_id=04316a1ae05044c48f003ab2872688f8, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:16.539306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3063ce8-ecde-4e29-b949-eafbeb307675 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:16.565570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 945/1877] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:16 2022] PUT /identity/v3/projects/f35667f7c48c4289bbd75063db6bc6a8/users/04316a1ae05044c48f003ab2872688f8/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:16.567510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850ea6a-2b26-4a5b-9120-e0b1208d2eb5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:16.587003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850ea6a-2b26-4a5b-9120-e0b1208d2eb5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:16.693057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:16.724705 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dc84e-4aef-4d11-bbeb-f9459b84cbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:16.725455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc84e-4aef-4d11-bbeb-f9459b84cbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:16.725677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc84e-4aef-4d11-bbeb-f9459b84cbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:16.725959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc84e-4aef-4d11-bbeb-f9459b84cbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:16.726734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dc84e-4aef-4d11-bbeb-f9459b84cbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:16.728414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dc84e-4aef-4d11-bbeb-f9459b84cbb4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:16.750963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 933/1878] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:16 2022] GET /identity/v3/roles => generated 1427 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:16.755441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3063ce8-ecde-4e29-b949-eafbeb307675 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:16.777719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3063ce8-ecde-4e29-b949-eafbeb307675 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:16.798790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f40a-351d-4f30-a53a-734345700a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:16.799786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f40a-351d-4f30-a53a-734345700a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:16.800069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f40a-351d-4f30-a53a-734345700a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:16.800352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f40a-351d-4f30-a53a-734345700a4c admin admin] PATH_INFO: `/v3/projects/f35667f7c48c4289bbd75063db6bc6a8/users/04316a1ae05044c48f003ab2872688f8/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:16.802462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26f40a-351d-4f30-a53a-734345700a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35667f7c48c4289bbd75063db6bc6a8, user_id=04316a1ae05044c48f003ab2872688f8, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:16.805136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26f40a-351d-4f30-a53a-734345700a4c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:16.847301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 946/1879] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:16 2022] PUT /identity/v3/projects/f35667f7c48c4289bbd75063db6bc6a8/users/04316a1ae05044c48f003ab2872688f8/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:16.859813 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3061-78e0-4b6a-a3f7-0af0291ae40e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:16.860250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3061-78e0-4b6a-a3f7-0af0291ae40e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:16.860574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3061-78e0-4b6a-a3f7-0af0291ae40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:16.896193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f40a-351d-4f30-a53a-734345700a4c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:16.898130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5f26f40a-351d-4f30-a53a-734345700a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:16.929917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:16.945367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-891a3061-78e0-4b6a-a3f7-0af0291ae40e None None] MFA Rules not processed for user `04316a1ae05044c48f003ab2872688f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:16.950645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-891a3061-78e0-4b6a-a3f7-0af0291ae40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:17.055976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f40a-351d-4f30-a53a-734345700a4c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:17.065620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9beb59-0ae6-4e0f-a3c9-f1a1a11429a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:17.066865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9beb59-0ae6-4e0f-a3c9-f1a1a11429a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:17.067152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9beb59-0ae6-4e0f-a3c9-f1a1a11429a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:17.067433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9beb59-0ae6-4e0f-a3c9-f1a1a11429a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:17.075744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa9beb59-0ae6-4e0f-a3c9-f1a1a11429a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:17.258508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 934/1880] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:17.281348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9beb59-0ae6-4e0f-a3c9-f1a1a11429a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:17.283630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9beb59-0ae6-4e0f-a3c9-f1a1a11429a5 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:17.301298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 947/1881] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:17.306791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3061-78e0-4b6a-a3f7-0af0291ae40e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:17.322998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3061-78e0-4b6a-a3f7-0af0291ae40e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:17.331649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47830ee-2700-4e03-9e26-2c558761f476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:17.331649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47830ee-2700-4e03-9e26-2c558761f476 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:17.331649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47830ee-2700-4e03-9e26-2c558761f476 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:17.332028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47830ee-2700-4e03-9e26-2c558761f476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:17.342966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47830ee-2700-4e03-9e26-2c558761f476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:17.344968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47830ee-2700-4e03-9e26-2c558761f476 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:17.362711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 935/1882] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:18.253638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9beb59-0ae6-4e0f-a3c9-f1a1a11429a5 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:18.376403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9beb59-0ae6-4e0f-a3c9-f1a1a11429a5 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:18.390266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:18.391855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:18.392180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:18.392997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] PATH_INFO: `/v3/users/2032a29929c44dff9ceaa0e8bbae66ce` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:18.394795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2032a29929c44dff9ceaa0e8bbae66ce)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:18.397868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:18.487392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47830ee-2700-4e03-9e26-2c558761f476 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:18.491262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2032a29929c44dff9ceaa0e8bbae66ce'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:18.493653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2032a29929c44dff9ceaa0e8bbae66ce'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:18.498577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47830ee-2700-4e03-9e26-2c558761f476 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:18.503214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2032a29929c44dff9ceaa0e8bbae66ce'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:18.504211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2032a29929c44dff9ceaa0e8bbae66ce'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:18.504605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:18.505991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:18.506585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:18.506933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:18.509363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:18.529182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f654c6cc-4f76-44fa-93af-d1a3f2f4e06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2032a29929c44dff9ceaa0e8bbae66ce'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:18.537258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:18.558826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 948/1883] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:18 2022] DELETE /identity/v3/users/2032a29929c44dff9ceaa0e8bbae66ce => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:18.563326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f88f-7acc-466a-8944-2ffae6ea68ab None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:18.563677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f88f-7acc-466a-8944-2ffae6ea68ab None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:18.564011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f88f-7acc-466a-8944-2ffae6ea68ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:18.594215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-84e7f88f-7acc-466a-8944-2ffae6ea68ab None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:18.595382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:18.595791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-84e7f88f-7acc-466a-8944-2ffae6ea68ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:18.597916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:18.616990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 936/1884] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:18.695695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 949/1885] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:18.703160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:18.705851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:18.804504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e4030-bc82-4f10-994c-ca3a34cb5efb service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:18.816854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:18.899171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b48cb-7872-4377-b3bd-3812c3cc0d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:18.899898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b48cb-7872-4377-b3bd-3812c3cc0d42 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:18.900185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b48cb-7872-4377-b3bd-3812c3cc0d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:18.900460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b48cb-7872-4377-b3bd-3812c3cc0d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:18.912570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b48cb-7872-4377-b3bd-3812c3cc0d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:18.914286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b48cb-7872-4377-b3bd-3812c3cc0d42 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:18.926929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 937/1886] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:19.334651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7f88f-7acc-466a-8944-2ffae6ea68ab None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:19.336316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-84e7f88f-7acc-466a-8944-2ffae6ea68ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:19.356121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7f88f-7acc-466a-8944-2ffae6ea68ab None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:19.365015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:19.366336 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:19.366640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:19.366979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] PATH_INFO: `/v3/projects/532ecc0218be4c99a2ca497017660d72` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:19.368481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532ecc0218be4c99a2ca497017660d72)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:19.371892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:19.431500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532ecc0218be4c99a2ca497017660d72', 'request_id': 'req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.440843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532ecc0218be4c99a2ca497017660d72', 'request_id': 'req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.449933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532ecc0218be4c99a2ca497017660d72', 'request_id': 'req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.463743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] The token cache is being invalidate because project 532ecc0218be4c99a2ca497017660d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:19.463743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.463743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.465516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 950/1887] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:19 2022] DELETE /identity/v3/projects/532ecc0218be4c99a2ca497017660d72 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:19.469499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b48cb-7872-4377-b3bd-3812c3cc0d42 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:19.480138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b48cb-7872-4377-b3bd-3812c3cc0d42 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:19.541404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:19.542509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:19.542798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:19.543077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] PATH_INFO: `/v3/users/04316a1ae05044c48f003ab2872688f8` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:19.545108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04316a1ae05044c48f003ab2872688f8)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:19.547203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:19.649565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04316a1ae05044c48f003ab2872688f8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.650336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04316a1ae05044c48f003ab2872688f8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.669085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04316a1ae05044c48f003ab2872688f8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.680018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04316a1ae05044c48f003ab2872688f8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.682759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-239edf58-f37a-45dd-8549-831a0f8c57a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04316a1ae05044c48f003ab2872688f8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:19.718266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 938/1888] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:19 2022] DELETE /identity/v3/users/04316a1ae05044c48f003ab2872688f8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:19.877425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:19.881022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:19.924907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd240-d285-4a51-8eb0-3a76c7a4ca26 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:20.026843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:20.027828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.028155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.028784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] PATH_INFO: `/v3/users/b95c59461a3f428884b22a014a6c785e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.029850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95c59461a3f428884b22a014a6c785e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:20.031918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:20.073671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:20.127310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95c59461a3f428884b22a014a6c785e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.128177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95c59461a3f428884b22a014a6c785e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.137679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95c59461a3f428884b22a014a6c785e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.138551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95c59461a3f428884b22a014a6c785e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.147696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95c59461a3f428884b22a014a6c785e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.189499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 951/1889] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:19 2022] DELETE /identity/v3/users/b95c59461a3f428884b22a014a6c785e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:20.194386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c90e2-4b94-4295-856b-9cf295409e7e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.194552 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c90e2-4b94-4295-856b-9cf295409e7e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.194757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c90e2-4b94-4295-856b-9cf295409e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.223343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-519c90e2-4b94-4295-856b-9cf295409e7e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:20.224031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:20.225353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-519c90e2-4b94-4295-856b-9cf295409e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:20.226254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:20.277253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:20.326765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 939/1890] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:20.338479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810d64-637f-475c-b641-925592c6f3b1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:20.344071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c90e2-4b94-4295-856b-9cf295409e7e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:20.346068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:20.346628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-519c90e2-4b94-4295-856b-9cf295409e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:20.347040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.347327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.347660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] PATH_INFO: `/v3/projects/f35667f7c48c4289bbd75063db6bc6a8` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.348892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35667f7c48c4289bbd75063db6bc6a8)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:20.352091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:20.412151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35667f7c48c4289bbd75063db6bc6a8', 'request_id': 'req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.420378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35667f7c48c4289bbd75063db6bc6a8', 'request_id': 'req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.431718 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35667f7c48c4289bbd75063db6bc6a8', 'request_id': 'req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.436666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c90e2-4b94-4295-856b-9cf295409e7e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:20.448073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] The token cache is being invalidate because project f35667f7c48c4289bbd75063db6bc6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:20.448293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.448987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cae25ee7-a6bf-4c86-b6a1-355b4cce4be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:20.450999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 952/1891] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:20 2022] DELETE /identity/v3/projects/f35667f7c48c4289bbd75063db6bc6a8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:20.457683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87910-0c37-48ef-85fc-5aa50abe64f4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.457971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87910-0c37-48ef-85fc-5aa50abe64f4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.458365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87910-0c37-48ef-85fc-5aa50abe64f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.480156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0ab87910-0c37-48ef-85fc-5aa50abe64f4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:20.483937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0ab87910-0c37-48ef-85fc-5aa50abe64f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:20.500812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:20.511351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109764a1-7f3c-4529-8a9b-c6d291b87313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:20.512179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109764a1-7f3c-4529-8a9b-c6d291b87313 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.512672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109764a1-7f3c-4529-8a9b-c6d291b87313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.513292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109764a1-7f3c-4529-8a9b-c6d291b87313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.515586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-109764a1-7f3c-4529-8a9b-c6d291b87313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:20.572605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 953/1892] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:20.575027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa900c68-5023-4330-b270-53ed68c7f531 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.575428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa900c68-5023-4330-b270-53ed68c7f531 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.575829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa900c68-5023-4330-b270-53ed68c7f531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.595212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109764a1-7f3c-4529-8a9b-c6d291b87313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:20.595846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fa900c68-5023-4330-b270-53ed68c7f531 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:20.596840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa900c68-5023-4330-b270-53ed68c7f531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:20.597744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109764a1-7f3c-4529-8a9b-c6d291b87313 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:20.607676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 954/1893] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:20.609400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 940/1894] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:20.610441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa900c68-5023-4330-b270-53ed68c7f531 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:20.620850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa900c68-5023-4330-b270-53ed68c7f531 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:20.626703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cd113-ec25-4616-a31e-2eb4220d967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:20.627901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cd113-ec25-4616-a31e-2eb4220d967d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.628189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cd113-ec25-4616-a31e-2eb4220d967d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.628464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cd113-ec25-4616-a31e-2eb4220d967d admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.629195 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cd113-ec25-4616-a31e-2eb4220d967d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:20.629507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cd113-ec25-4616-a31e-2eb4220d967d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:20.631115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cd113-ec25-4616-a31e-2eb4220d967d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:20.649908 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 955/1895] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:28:20.652197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109764a1-7f3c-4529-8a9b-c6d291b87313 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:20.664251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109764a1-7f3c-4529-8a9b-c6d291b87313 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:20.673257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb29e-4735-4d42-9dbf-43b5078cb4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:20.675214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb29e-4735-4d42-9dbf-43b5078cb4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.675585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb29e-4735-4d42-9dbf-43b5078cb4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.675859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bb29e-4735-4d42-9dbf-43b5078cb4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.676641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bb29e-4735-4d42-9dbf-43b5078cb4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:20.679877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bb29e-4735-4d42-9dbf-43b5078cb4b0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:20.716853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 941/1896] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:20 2022] POST /identity/v3/projects => generated 374 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:20.721872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cd113-ec25-4616-a31e-2eb4220d967d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:20.735868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cd113-ec25-4616-a31e-2eb4220d967d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:20.810878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36583a8-0ae3-41a6-ae13-20286f19f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:20.811815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36583a8-0ae3-41a6-ae13-20286f19f5da admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.812256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36583a8-0ae3-41a6-ae13-20286f19f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.813283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36583a8-0ae3-41a6-ae13-20286f19f5da admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.813621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36583a8-0ae3-41a6-ae13-20286f19f5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:20.816503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36583a8-0ae3-41a6-ae13-20286f19f5da admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:20.842721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 956/1897] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:20 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:20.847584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb29e-4735-4d42-9dbf-43b5078cb4b0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:20.862210 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bb29e-4735-4d42-9dbf-43b5078cb4b0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:20.867512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4881e7-aba6-4983-a724-b5d5ef133030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:20.868518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4881e7-aba6-4983-a724-b5d5ef133030 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.869222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4881e7-aba6-4983-a724-b5d5ef133030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.869601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4881e7-aba6-4983-a724-b5d5ef133030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.870672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4881e7-aba6-4983-a724-b5d5ef133030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:20.872816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4881e7-aba6-4983-a724-b5d5ef133030 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:20.895268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36583a8-0ae3-41a6-ae13-20286f19f5da admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:20.908583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 942/1898] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:20 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:20.908878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36583a8-0ae3-41a6-ae13-20286f19f5da admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:20.916004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5bd6e-b504-4d91-b73d-297494a7e5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:20.917328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5bd6e-b504-4d91-b73d-297494a7e5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:20.917915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5bd6e-b504-4d91-b73d-297494a7e5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:20.918060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5bd6e-b504-4d91-b73d-297494a7e5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:20.919184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5bd6e-b504-4d91-b73d-297494a7e5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:20.921416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5bd6e-b504-4d91-b73d-297494a7e5ac admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:20.957019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 957/1899] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:20 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:20.963459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4881e7-aba6-4983-a724-b5d5ef133030 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:20.977991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4881e7-aba6-4983-a724-b5d5ef133030 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:20.999140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cab93-129c-4745-90ce-db361b79a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:21.000639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cab93-129c-4745-90ce-db361b79a5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:21.001076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cab93-129c-4745-90ce-db361b79a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:21.001538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cab93-129c-4745-90ce-db361b79a5cd admin admin] PATH_INFO: `/v3/projects/c037b844abc04632a37c3e3b3310bc12/users/777390bc7d4c47e3a50c834f13caa15c/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:21.010442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:21.030434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cab93-129c-4745-90ce-db361b79a5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c037b844abc04632a37c3e3b3310bc12, user_id=777390bc7d4c47e3a50c834f13caa15c, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:21.033568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cab93-129c-4745-90ce-db361b79a5cd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:21.061804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 943/1900] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:20 2022] PUT /identity/v3/projects/c037b844abc04632a37c3e3b3310bc12/users/777390bc7d4c47e3a50c834f13caa15c/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:21.068397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fd7be-b44a-4b12-a37e-bc42993eeb06 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:21.068688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fd7be-b44a-4b12-a37e-bc42993eeb06 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:21.069967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fd7be-b44a-4b12-a37e-bc42993eeb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:21.092094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5f4fd7be-b44a-4b12-a37e-bc42993eeb06 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:21.094212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5f4fd7be-b44a-4b12-a37e-bc42993eeb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:21.188756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 958/1901] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:21.201440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cab93-129c-4745-90ce-db361b79a5cd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:21.203247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fd7cab93-129c-4745-90ce-db361b79a5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:21.286478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fd7be-b44a-4b12-a37e-bc42993eeb06 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:21.288316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5f4fd7be-b44a-4b12-a37e-bc42993eeb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:21.292427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cab93-129c-4745-90ce-db361b79a5cd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:21.298170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63f603-8389-406d-ac9e-9877ea1197dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:21.302073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f603-8389-406d-ac9e-9877ea1197dc service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:21.302376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f603-8389-406d-ac9e-9877ea1197dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:21.302598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63f603-8389-406d-ac9e-9877ea1197dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:21.315793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fd7be-b44a-4b12-a37e-bc42993eeb06 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:21.323334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63f603-8389-406d-ac9e-9877ea1197dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:21.325205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63f603-8389-406d-ac9e-9877ea1197dc service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:21.333505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:21.334388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:21.334669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:21.334944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] PATH_INFO: `/v3/projects/85364e40fd2b48afb4bafe2b7913ba87` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:21.341186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 944/1902] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:21.341853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85364e40fd2b48afb4bafe2b7913ba87)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:21.343825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:21.364608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:21.400997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85364e40fd2b48afb4bafe2b7913ba87', 'request_id': 'req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.407761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85364e40fd2b48afb4bafe2b7913ba87', 'request_id': 'req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.428265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85364e40fd2b48afb4bafe2b7913ba87', 'request_id': 'req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.445990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] The token cache is being invalidate because project 85364e40fd2b48afb4bafe2b7913ba87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:21.447237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.447936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.450451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 959/1903] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:21 2022] DELETE /identity/v3/projects/85364e40fd2b48afb4bafe2b7913ba87 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:21.454209 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63f603-8389-406d-ac9e-9877ea1197dc service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:21.469500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63f603-8389-406d-ac9e-9877ea1197dc service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:21.561072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:21.562026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:21.562309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:21.562822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] PATH_INFO: `/v3/users/e7bb277612e94347b5807dd071bbf9e1` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:21.564696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bb277612e94347b5807dd071bbf9e1)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:21.569389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:21.659985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bb277612e94347b5807dd071bbf9e1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.661499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bb277612e94347b5807dd071bbf9e1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.691872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bb277612e94347b5807dd071bbf9e1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.703131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bb277612e94347b5807dd071bbf9e1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.704061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-17e843c6-7cc7-432a-a18f-7a9d0d409cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bb277612e94347b5807dd071bbf9e1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:21.731863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 945/1904] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:21 2022] DELETE /identity/v3/users/e7bb277612e94347b5807dd071bbf9e1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:22.767094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:22.769181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:22.791255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d4a7-a320-41a8-9ef1-6ece50737d1e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:22.792633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d940e-d191-4cdf-ad6e-825c68f246dd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:22.793055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d940e-d191-4cdf-ad6e-825c68f246dd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:22.793392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d940e-d191-4cdf-ad6e-825c68f246dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:22.802747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:22.902303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d52d940e-d191-4cdf-ad6e-825c68f246dd None None] MFA Rules not processed for user `777390bc7d4c47e3a50c834f13caa15c`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:22.908237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d52d940e-d191-4cdf-ad6e-825c68f246dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:22.960790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:22.962687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:22.964993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:22.965889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] PATH_INFO: `/v3/projects/863ba73d8f04408bb6467918c3c0c981` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:22.968175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863ba73d8f04408bb6467918c3c0c981)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:22.971681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:23.051733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863ba73d8f04408bb6467918c3c0c981', 'request_id': 'req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:23.056889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 946/1905] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:23.065490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863ba73d8f04408bb6467918c3c0c981', 'request_id': 'req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:23.070118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d940e-d191-4cdf-ad6e-825c68f246dd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:23.071776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d52d940e-d191-4cdf-ad6e-825c68f246dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:23.089281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863ba73d8f04408bb6467918c3c0c981', 'request_id': 'req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:23.115886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] The token cache is being invalidate because project 863ba73d8f04408bb6467918c3c0c981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:23.116543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:23.117612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e10b657e-c1fd-4a26-9b07-8ae3fb56e460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:23.119625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 960/1906] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:22 2022] DELETE /identity/v3/projects/863ba73d8f04408bb6467918c3c0c981 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:23.124717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312b33b-42a7-4564-a170-f1159af32c96 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.125091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312b33b-42a7-4564-a170-f1159af32c96 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.125448 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312b33b-42a7-4564-a170-f1159af32c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.150225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6312b33b-42a7-4564-a170-f1159af32c96 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:23.151612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6312b33b-42a7-4564-a170-f1159af32c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:23.163942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d940e-d191-4cdf-ad6e-825c68f246dd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:23.220071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:23.268435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ac049-7baf-43fa-9b2c-13687d6c2c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:23.269012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac049-7baf-43fa-9b2c-13687d6c2c4c service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.269453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac049-7baf-43fa-9b2c-13687d6c2c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.269631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac049-7baf-43fa-9b2c-13687d6c2c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.272214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-dd2ac049-7baf-43fa-9b2c-13687d6c2c4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:23.320474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 961/1907] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:23.328658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46521c-412c-416f-a838-b4be55ede02b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.329014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46521c-412c-416f-a838-b4be55ede02b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.329291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46521c-412c-416f-a838-b4be55ede02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.351425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-de46521c-412c-416f-a838-b4be55ede02b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:23.352758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-de46521c-412c-416f-a838-b4be55ede02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:23.364532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ac049-7baf-43fa-9b2c-13687d6c2c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:23.368790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ac049-7baf-43fa-9b2c-13687d6c2c4c service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:23.370786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 962/1908] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:23.371765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46521c-412c-416f-a838-b4be55ede02b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:23.382429 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46521c-412c-416f-a838-b4be55ede02b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:23.383501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 947/1909] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:23.387466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab51bb-3333-4588-a129-380043b19c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:23.388145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab51bb-3333-4588-a129-380043b19c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.388433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab51bb-3333-4588-a129-380043b19c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.388716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab51bb-3333-4588-a129-380043b19c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.389589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab51bb-3333-4588-a129-380043b19c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:23.390319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab51bb-3333-4588-a129-380043b19c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:23.391575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab51bb-3333-4588-a129-380043b19c87 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:23.412407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 963/1910] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:23.413393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ac049-7baf-43fa-9b2c-13687d6c2c4c service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:23.422653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:23.435042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ac049-7baf-43fa-9b2c-13687d6c2c4c service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:23.450896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63236-5117-4ff8-afe1-5e32a9202639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:23.452797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63236-5117-4ff8-afe1-5e32a9202639 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.452797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63236-5117-4ff8-afe1-5e32a9202639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.452797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63236-5117-4ff8-afe1-5e32a9202639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.453181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63236-5117-4ff8-afe1-5e32a9202639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:23.455192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63236-5117-4ff8-afe1-5e32a9202639 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:23.514746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 948/1911] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:23 2022] POST /identity/v3/projects => generated 392 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:23.520597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab51bb-3333-4588-a129-380043b19c87 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:23.533843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab51bb-3333-4588-a129-380043b19c87 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:23.646913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388bc0d-ceff-4a80-bd1a-d706946591f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:23.647830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388bc0d-ceff-4a80-bd1a-d706946591f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.648651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388bc0d-ceff-4a80-bd1a-d706946591f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.649132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388bc0d-ceff-4a80-bd1a-d706946591f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.649958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388bc0d-ceff-4a80-bd1a-d706946591f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:23.652571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388bc0d-ceff-4a80-bd1a-d706946591f2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:23.710483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 964/1912] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:23 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:23.715183 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63236-5117-4ff8-afe1-5e32a9202639 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:23.729242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63236-5117-4ff8-afe1-5e32a9202639 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:23.738815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992fc1-b341-4886-9806-69096831781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:23.741660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992fc1-b341-4886-9806-69096831781c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.742027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992fc1-b341-4886-9806-69096831781c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.743845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992fc1-b341-4886-9806-69096831781c admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.744933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992fc1-b341-4886-9806-69096831781c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:23.746832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992fc1-b341-4886-9806-69096831781c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:23.758896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388bc0d-ceff-4a80-bd1a-d706946591f2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:23.763538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9388bc0d-ceff-4a80-bd1a-d706946591f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:23.802330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 949/1913] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:23 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:23.802983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388bc0d-ceff-4a80-bd1a-d706946591f2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:23.806873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992fc1-b341-4886-9806-69096831781c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:23.813645 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:23.816400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.817866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.818190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] PATH_INFO: `/v3/users/055ef29043e34b85a23af6b575783853` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.822926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055ef29043e34b85a23af6b575783853)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:23.827019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:23.836027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992fc1-b341-4886-9806-69096831781c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:23.869895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3141-b818-45bb-a66e-0d980ab725dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:23.873782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3141-b818-45bb-a66e-0d980ab725dc admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.873782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3141-b818-45bb-a66e-0d980ab725dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.873961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa3141-b818-45bb-a66e-0d980ab725dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.879394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa3141-b818-45bb-a66e-0d980ab725dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:23.884981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa3141-b818-45bb-a66e-0d980ab725dc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:23.921919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 950/1914] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:23 2022] GET /identity/v3/roles => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:23.924751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3141-b818-45bb-a66e-0d980ab725dc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:23.950086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa3141-b818-45bb-a66e-0d980ab725dc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:23.967530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7833f-4572-4141-ab02-ae171388f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:23.969754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7833f-4572-4141-ab02-ae171388f634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:23.970041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7833f-4572-4141-ab02-ae171388f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:23.971343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7833f-4572-4141-ab02-ae171388f634 admin admin] PATH_INFO: `/v3/projects/678c742869ba4fc683d61900af5728df/users/a17efb27d51c4703a0cf32fb00485b42/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:23.974682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055ef29043e34b85a23af6b575783853'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:23.975912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055ef29043e34b85a23af6b575783853'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:23.993832 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055ef29043e34b85a23af6b575783853'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:23.995339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055ef29043e34b85a23af6b575783853'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:24.013374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd56bad4-5b6c-4ae5-90eb-29e904abcfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055ef29043e34b85a23af6b575783853'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:24.019746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7833f-4572-4141-ab02-ae171388f634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=678c742869ba4fc683d61900af5728df, user_id=a17efb27d51c4703a0cf32fb00485b42, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:24.025146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7833f-4572-4141-ab02-ae171388f634 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:24.060672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 951/1915] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:23 2022] PUT /identity/v3/projects/678c742869ba4fc683d61900af5728df/users/a17efb27d51c4703a0cf32fb00485b42/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:24.060878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 965/1916] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:23 2022] DELETE /identity/v3/users/055ef29043e34b85a23af6b575783853 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:24.060964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77028f-62eb-4aeb-9928-ac128c218b4f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:24.060964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77028f-62eb-4aeb-9928-ac128c218b4f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:24.060964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77028f-62eb-4aeb-9928-ac128c218b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:24.062497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb46de-f0f9-4b65-a7ea-16c83a1dbb80 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:24.062792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb46de-f0f9-4b65-a7ea-16c83a1dbb80 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:24.063082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb46de-f0f9-4b65-a7ea-16c83a1dbb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:24.101934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8a77028f-62eb-4aeb-9928-ac128c218b4f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:24.103239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8a77028f-62eb-4aeb-9928-ac128c218b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:24.105439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-deeb46de-f0f9-4b65-a7ea-16c83a1dbb80 None None] MFA Rules not processed for user `a17efb27d51c4703a0cf32fb00485b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:24.107353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-deeb46de-f0f9-4b65-a7ea-16c83a1dbb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:24.112278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:24.211144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 952/1917] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:24.228583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77028f-62eb-4aeb-9928-ac128c218b4f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:24.231117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8a77028f-62eb-4aeb-9928-ac128c218b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:24.233175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 966/1918] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:24.235498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb46de-f0f9-4b65-a7ea-16c83a1dbb80 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:24.243578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-deeb46de-f0f9-4b65-a7ea-16c83a1dbb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:24.287787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb46de-f0f9-4b65-a7ea-16c83a1dbb80 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:24.302124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295c9de-5638-4314-bbb5-010f987f5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:24.302810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295c9de-5638-4314-bbb5-010f987f5448 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:24.303096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295c9de-5638-4314-bbb5-010f987f5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:24.303374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295c9de-5638-4314-bbb5-010f987f5448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:24.304192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295c9de-5638-4314-bbb5-010f987f5448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:24.306174 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295c9de-5638-4314-bbb5-010f987f5448 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:24.350911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77028f-62eb-4aeb-9928-ac128c218b4f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:24.351777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 967/1919] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:24 2022] POST /identity/v3/projects => generated 394 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:24.352788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295c9de-5638-4314-bbb5-010f987f5448 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:24.355328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f295c9de-5638-4314-bbb5-010f987f5448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:24.428322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb99ca7-2c21-42cd-b01d-2985844e68c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:24.429357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb99ca7-2c21-42cd-b01d-2985844e68c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:24.429716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb99ca7-2c21-42cd-b01d-2985844e68c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:24.430062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb99ca7-2c21-42cd-b01d-2985844e68c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:24.438487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295c9de-5638-4314-bbb5-010f987f5448 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:24.442463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:24.445782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:24.446933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:24.447224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:24.447506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] PATH_INFO: `/v3/users/8943932eca9e4da88a025e9b8cde38c1` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:24.447714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb99ca7-2c21-42cd-b01d-2985844e68c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:24.448853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8943932eca9e4da88a025e9b8cde38c1)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:24.450059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb99ca7-2c21-42cd-b01d-2985844e68c7 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:24.450967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:24.473449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 953/1920] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:24.474308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb99ca7-2c21-42cd-b01d-2985844e68c7 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:24.496082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb99ca7-2c21-42cd-b01d-2985844e68c7 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:24.511099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3273b13-10b4-4526-be7a-53cbb60e0996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:24.511582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273b13-10b4-4526-be7a-53cbb60e0996 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:24.512019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273b13-10b4-4526-be7a-53cbb60e0996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:24.512476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3273b13-10b4-4526-be7a-53cbb60e0996 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:24.513194 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3273b13-10b4-4526-be7a-53cbb60e0996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:24.522058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3273b13-10b4-4526-be7a-53cbb60e0996 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:24.570975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8943932eca9e4da88a025e9b8cde38c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:24.573310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8943932eca9e4da88a025e9b8cde38c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:24.594733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 954/1921] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:24 2022] POST /identity/v3/users => generated 304 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:24.599425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3273b13-10b4-4526-be7a-53cbb60e0996 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:24.600114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8943932eca9e4da88a025e9b8cde38c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:24.602200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8943932eca9e4da88a025e9b8cde38c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:24.609375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a3273b13-10b4-4526-be7a-53cbb60e0996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:24.630500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408ac1ff-eb6a-4ff5-abe9-583e8ce346e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8943932eca9e4da88a025e9b8cde38c1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:24.675329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 968/1922] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:24 2022] DELETE /identity/v3/users/8943932eca9e4da88a025e9b8cde38c1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:24.675526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3273b13-10b4-4526-be7a-53cbb60e0996 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:24.677921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483c32-f629-48e5-ae23-5c8c75bf32bc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:24.678198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483c32-f629-48e5-ae23-5c8c75bf32bc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:24.678691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483c32-f629-48e5-ae23-5c8c75bf32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:24.692672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:24.726216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d9483c32-f629-48e5-ae23-5c8c75bf32bc None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:24.730924 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d9483c32-f629-48e5-ae23-5c8c75bf32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:24.839156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f7ca3-e36a-41ea-a6c5-da73ab529a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:24.839914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f7ca3-e36a-41ea-a6c5-da73ab529a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:24.840274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f7ca3-e36a-41ea-a6c5-da73ab529a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:24.840629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f7ca3-e36a-41ea-a6c5-da73ab529a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:24.841484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f7ca3-e36a-41ea-a6c5-da73ab529a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:24.843646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f7ca3-e36a-41ea-a6c5-da73ab529a6e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:24.858476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 955/1923] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:24 2022] GET /identity/v3/roles => generated 1427 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:24.862882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f7ca3-e36a-41ea-a6c5-da73ab529a6e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:24.875597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f7ca3-e36a-41ea-a6c5-da73ab529a6e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:24.883332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec6bf-ec8b-4bab-b7a5-562e9a9efbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:24.884484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec6bf-ec8b-4bab-b7a5-562e9a9efbfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:24.884871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec6bf-ec8b-4bab-b7a5-562e9a9efbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:24.885452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec6bf-ec8b-4bab-b7a5-562e9a9efbfc admin admin] PATH_INFO: `/v3/projects/3ce7c65b42e84abfaf147695aa103474/users/ed21f645bf5946e88829296126e8b4a9/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:24.893285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 969/1924] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:24.913455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec6bf-ec8b-4bab-b7a5-562e9a9efbfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce7c65b42e84abfaf147695aa103474, user_id=ed21f645bf5946e88829296126e8b4a9, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:24.917893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ec6bf-ec8b-4bab-b7a5-562e9a9efbfc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:24.940163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 956/1925] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:24 2022] PUT /identity/v3/projects/3ce7c65b42e84abfaf147695aa103474/users/ed21f645bf5946e88829296126e8b4a9/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:24.943633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483c32-f629-48e5-ae23-5c8c75bf32bc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:24.956326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483c32-f629-48e5-ae23-5c8c75bf32bc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:25.128247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec6bf-ec8b-4bab-b7a5-562e9a9efbfc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:25.131396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-150ec6bf-ec8b-4bab-b7a5-562e9a9efbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:25.142287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e11eb-bb20-44d2-85fc-a0690d9a34a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:25.143000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e11eb-bb20-44d2-85fc-a0690d9a34a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:25.143293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e11eb-bb20-44d2-85fc-a0690d9a34a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:25.145746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e11eb-bb20-44d2-85fc-a0690d9a34a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:25.146534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e11eb-bb20-44d2-85fc-a0690d9a34a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:25.148274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e11eb-bb20-44d2-85fc-a0690d9a34a4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:25.175742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 970/1926] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:24 2022] GET /identity/v3/roles => generated 1427 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:25.176636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e11eb-bb20-44d2-85fc-a0690d9a34a4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:25.191632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e11eb-bb20-44d2-85fc-a0690d9a34a4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:25.199016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424887-c05a-4cf3-b7d6-a01f2a929608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:25.200524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424887-c05a-4cf3-b7d6-a01f2a929608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:25.200524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424887-c05a-4cf3-b7d6-a01f2a929608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:25.200742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424887-c05a-4cf3-b7d6-a01f2a929608 admin admin] PATH_INFO: `/v3/projects/3ce7c65b42e84abfaf147695aa103474/users/ed21f645bf5946e88829296126e8b4a9/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:25.203111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424887-c05a-4cf3-b7d6-a01f2a929608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce7c65b42e84abfaf147695aa103474, user_id=ed21f645bf5946e88829296126e8b4a9, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:25.206909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424887-c05a-4cf3-b7d6-a01f2a929608 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:25.228513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 971/1927] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:25 2022] PUT /identity/v3/projects/3ce7c65b42e84abfaf147695aa103474/users/ed21f645bf5946e88829296126e8b4a9/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:25.239656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec42f3-957e-4a25-ba74-f7ce443175d0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:25.240746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec42f3-957e-4a25-ba74-f7ce443175d0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:25.241185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec42f3-957e-4a25-ba74-f7ce443175d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:25.249144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec6bf-ec8b-4bab-b7a5-562e9a9efbfc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:25.278804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-15ec42f3-957e-4a25-ba74-f7ce443175d0 None None] MFA Rules not processed for user `ed21f645bf5946e88829296126e8b4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:25.282318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-15ec42f3-957e-4a25-ba74-f7ce443175d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:25.367408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d875f-8e69-46b9-92c1-eacbaefaec2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:25.369763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d875f-8e69-46b9-92c1-eacbaefaec2a service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:25.376534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d875f-8e69-46b9-92c1-eacbaefaec2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:25.377303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d875f-8e69-46b9-92c1-eacbaefaec2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:25.411419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 972/1928] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:25.412739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec42f3-957e-4a25-ba74-f7ce443175d0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:25.416583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:25.421854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-15ec42f3-957e-4a25-ba74-f7ce443175d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:25.441637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:25.495732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d875f-8e69-46b9-92c1-eacbaefaec2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:25.497462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d875f-8e69-46b9-92c1-eacbaefaec2a service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:25.516911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 957/1929] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:25.517880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d875f-8e69-46b9-92c1-eacbaefaec2a service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:25.519312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d37d875f-8e69-46b9-92c1-eacbaefaec2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:25.539217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec42f3-957e-4a25-ba74-f7ce443175d0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:25.547066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:25.549204 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:25.549803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:25.550444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] PATH_INFO: `/v3/projects/2aecf83cde444405a2fa82a5cc290cd6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:25.552101 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aecf83cde444405a2fa82a5cc290cd6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:25.554159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:25.599593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d875f-8e69-46b9-92c1-eacbaefaec2a service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:25.609859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5930-ccce-413b-aa21-988c1a517cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:25.610982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5930-ccce-413b-aa21-988c1a517cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:25.611272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5930-ccce-413b-aa21-988c1a517cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:25.611546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e5930-ccce-413b-aa21-988c1a517cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:25.631706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e5930-ccce-413b-aa21-988c1a517cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:25.632943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aecf83cde444405a2fa82a5cc290cd6', 'request_id': 'req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.633585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e5930-ccce-413b-aa21-988c1a517cd5 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:25.641790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aecf83cde444405a2fa82a5cc290cd6', 'request_id': 'req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.648244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 958/1930] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:25.662314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aecf83cde444405a2fa82a5cc290cd6', 'request_id': 'req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.678186 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] The token cache is being invalidate because project 2aecf83cde444405a2fa82a5cc290cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:25.678500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.679303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.681115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 973/1931] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:25 2022] DELETE /identity/v3/projects/2aecf83cde444405a2fa82a5cc290cd6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:25.685187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5930-ccce-413b-aa21-988c1a517cd5 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:25.701748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e5930-ccce-413b-aa21-988c1a517cd5 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:25.709780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:25.711614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:25.768225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:25.769294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:25.769586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:25.769867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] PATH_INFO: `/v3/users/01cc4ca49fcc41d799e2587fc7cd468d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:25.771144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cc4ca49fcc41d799e2587fc7cd468d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:25.773372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:25.789874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2b45b-ebab-4ef3-8cb7-e1bf1fab94a3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:25.795372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:25.796407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:25.796747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:25.797031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:25.799607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:25.843030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cc4ca49fcc41d799e2587fc7cd468d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.844151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cc4ca49fcc41d799e2587fc7cd468d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.863686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:25.867039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cc4ca49fcc41d799e2587fc7cd468d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.875102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:25.878468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:25.878648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cc4ca49fcc41d799e2587fc7cd468d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.879343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af847e17-f768-4b61-b920-a77d44ce4e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cc4ca49fcc41d799e2587fc7cd468d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:25.883037 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:25.896848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 959/1932] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:25 2022] DELETE /identity/v3/users/01cc4ca49fcc41d799e2587fc7cd468d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:25.898906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 974/1933] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:26.195530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b53ae-4e37-489a-a9e8-4fab8cb3a94b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:26.195844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b53ae-4e37-489a-a9e8-4fab8cb3a94b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:26.196174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b53ae-4e37-489a-a9e8-4fab8cb3a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:26.229172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1e3b53ae-4e37-489a-a9e8-4fab8cb3a94b None None] MFA Rules not processed for user `777390bc7d4c47e3a50c834f13caa15c`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:26.231946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1e3b53ae-4e37-489a-a9e8-4fab8cb3a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:26.373325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:26.375951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:26.397145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 960/1934] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:26.415980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a9324-adee-452c-b61b-acd76889b801 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:26.441419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b53ae-4e37-489a-a9e8-4fab8cb3a94b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:26.443240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1e3b53ae-4e37-489a-a9e8-4fab8cb3a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:26.548040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:26.549476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:26.549757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:26.550030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] PATH_INFO: `/v3/projects/3ef6cd458e8f4789a209e350bebce032` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:26.552672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef6cd458e8f4789a209e350bebce032)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:26.556463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:26.593713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b53ae-4e37-489a-a9e8-4fab8cb3a94b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:26.606108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:26.606990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:26.607271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:26.607543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] PATH_INFO: `/v3/projects/2ee1ca21799b4a1db4ae67844af326c7` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:26.610388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee1ca21799b4a1db4ae67844af326c7)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:26.613035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:26.651832 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef6cd458e8f4789a209e350bebce032', 'request_id': 'req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.664310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef6cd458e8f4789a209e350bebce032', 'request_id': 'req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.682944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef6cd458e8f4789a209e350bebce032', 'request_id': 'req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.711997 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] The token cache is being invalidate because project 3ef6cd458e8f4789a209e350bebce032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:26.712280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.715661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.719887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee1ca21799b4a1db4ae67844af326c7', 'request_id': 'req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.723098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 975/1935] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:26 2022] DELETE /identity/v3/projects/3ef6cd458e8f4789a209e350bebce032 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:26.726080 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:26.729498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:26.731254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee1ca21799b4a1db4ae67844af326c7', 'request_id': 'req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.745117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee1ca21799b4a1db4ae67844af326c7', 'request_id': 'req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.767546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] The token cache is being invalidate because project 2ee1ca21799b4a1db4ae67844af326c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:26.768354 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.771041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:26.775070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 961/1936] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:26 2022] DELETE /identity/v3/projects/2ee1ca21799b4a1db4ae67844af326c7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:26.779003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:26.781974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:26.825812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:26.851344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71185cfe-b2d0-4a07-b1b8-afa0b9eb2ba3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:26.897562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:26.938809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:26.939768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:26.940056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:26.940334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] PATH_INFO: `/v3/users/e0cf8ccd507e466eb66a63f5062ade95` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:26.941800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0cf8ccd507e466eb66a63f5062ade95)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:26.943812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:26.962028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70bc5a-e9ff-4b95-8240-dd71e7ac0fe8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:26.979576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:26.980481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:26.981117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:26.981407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] PATH_INFO: `/v3/users/6afad9af88a0474f83ce88ba29ee2d9a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:26.982626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afad9af88a0474f83ce88ba29ee2d9a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:26.984648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:27.049490 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0cf8ccd507e466eb66a63f5062ade95'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.052716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0cf8ccd507e466eb66a63f5062ade95'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.060649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0cf8ccd507e466eb66a63f5062ade95'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.061447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0cf8ccd507e466eb66a63f5062ade95'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.069709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afad9af88a0474f83ce88ba29ee2d9a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.071452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0cf8ccd507e466eb66a63f5062ade95'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.071948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afad9af88a0474f83ce88ba29ee2d9a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.099877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 976/1937] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:26 2022] DELETE /identity/v3/users/e0cf8ccd507e466eb66a63f5062ade95 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:27.104989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afad9af88a0474f83ce88ba29ee2d9a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.117193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afad9af88a0474f83ce88ba29ee2d9a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.117966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afad9af88a0474f83ce88ba29ee2d9a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:27.143674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 962/1938] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:26 2022] DELETE /identity/v3/users/6afad9af88a0474f83ce88ba29ee2d9a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:27.910304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:27.911832 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:28.078579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63742d3a-989f-490b-8c02-a334e114aed2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:28.179124 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:28.180418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:28.299884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:28.300782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:28.301071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:28.301353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] PATH_INFO: `/v3/projects/e299c8e6cd6a47f1a672a43b58f9215b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:28.302945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e299c8e6cd6a47f1a672a43b58f9215b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:28.304991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:28.320539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:28.348579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd85a84-0ac9-44ee-ab18-b0faf0f264dc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:28.356216 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:28.356862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:28.357143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:28.357383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] PATH_INFO: `/v3/projects/9a991db725de47e09129f544c3d2ed0f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:28.358750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a991db725de47e09129f544c3d2ed0f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:28.361779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:28.453841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:28.460095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e299c8e6cd6a47f1a672a43b58f9215b', 'request_id': 'req-2d12e510-88ff-4ea7-baae-f237504f1b09'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.467745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e299c8e6cd6a47f1a672a43b58f9215b', 'request_id': 'req-2d12e510-88ff-4ea7-baae-f237504f1b09'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.480950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a991db725de47e09129f544c3d2ed0f', 'request_id': 'req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.481751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e299c8e6cd6a47f1a672a43b58f9215b', 'request_id': 'req-2d12e510-88ff-4ea7-baae-f237504f1b09'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.491027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a991db725de47e09129f544c3d2ed0f', 'request_id': 'req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.503107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] The token cache is being invalidate because project e299c8e6cd6a47f1a672a43b58f9215b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:28.503823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.504841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2d12e510-88ff-4ea7-baae-f237504f1b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.508476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 977/1939] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:27 2022] DELETE /identity/v3/projects/e299c8e6cd6a47f1a672a43b58f9215b => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:28.509584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a991db725de47e09129f544c3d2ed0f', 'request_id': 'req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.514456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009e944-77b9-4066-83c1-a319220c513f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:28.515067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009e944-77b9-4066-83c1-a319220c513f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:28.515647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009e944-77b9-4066-83c1-a319220c513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:28.533454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] The token cache is being invalidate because project 9a991db725de47e09129f544c3d2ed0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:28.533808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.534656 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4c2ac48d-85bb-45f9-b0f2-2e66a33868f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:28.537161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 963/1940] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:28 2022] DELETE /identity/v3/projects/9a991db725de47e09129f544c3d2ed0f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:28.553883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5794d-0f16-40c3-9fdc-6796075d77dd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:28.560397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5794d-0f16-40c3-9fdc-6796075d77dd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:28.560397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5794d-0f16-40c3-9fdc-6796075d77dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:28.562921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8009e944-77b9-4066-83c1-a319220c513f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:28.568230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8009e944-77b9-4066-83c1-a319220c513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:28.612287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7ca5794d-0f16-40c3-9fdc-6796075d77dd None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:28.614390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7ca5794d-0f16-40c3-9fdc-6796075d77dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:28.770068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 964/1941] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:28.780521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb644c1-6b30-4b31-8039-08b0860d3038 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:28.781060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb644c1-6b30-4b31-8039-08b0860d3038 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:28.781395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb644c1-6b30-4b31-8039-08b0860d3038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:28.782282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 978/1942] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:28.787771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaceaf-625b-44f1-97d2-da281995d6e6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:28.788231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaceaf-625b-44f1-97d2-da281995d6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:28.789384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaceaf-625b-44f1-97d2-da281995d6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:28.816135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8fcaceaf-625b-44f1-97d2-da281995d6e6 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:28.817365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8fcaceaf-625b-44f1-97d2-da281995d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:28.828219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 979/1943] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:28.834864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaceaf-625b-44f1-97d2-da281995d6e6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:28.835580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5cb644c1-6b30-4b31-8039-08b0860d3038 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:28.836938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5cb644c1-6b30-4b31-8039-08b0860d3038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:28.847224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaceaf-625b-44f1-97d2-da281995d6e6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:28.850303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 965/1944] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:28.859886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb644c1-6b30-4b31-8039-08b0860d3038 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:28.860955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db87a7a-572d-4631-974d-904fb7e4e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:28.861733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db87a7a-572d-4631-974d-904fb7e4e936 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:28.862087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db87a7a-572d-4631-974d-904fb7e4e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:28.862440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db87a7a-572d-4631-974d-904fb7e4e936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:28.863257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db87a7a-572d-4631-974d-904fb7e4e936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:28.863663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db87a7a-572d-4631-974d-904fb7e4e936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:28.865440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db87a7a-572d-4631-974d-904fb7e4e936 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:28.881930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb644c1-6b30-4b31-8039-08b0860d3038 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:28.884816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 980/1945] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:28:28.885425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db87a7a-572d-4631-974d-904fb7e4e936 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:28.898244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db87a7a-572d-4631-974d-904fb7e4e936 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:28.903930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99130c-9283-4cb5-b18e-ac01429ca86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:28.905115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99130c-9283-4cb5-b18e-ac01429ca86d admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:28.905625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99130c-9283-4cb5-b18e-ac01429ca86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:28.906036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99130c-9283-4cb5-b18e-ac01429ca86d admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:28.910172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99130c-9283-4cb5-b18e-ac01429ca86d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:28.910917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99130c-9283-4cb5-b18e-ac01429ca86d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:28.914862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99130c-9283-4cb5-b18e-ac01429ca86d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:28.918988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060fd43-65dd-4ff3-808e-3e7c56d12340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:28.920008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060fd43-65dd-4ff3-808e-3e7c56d12340 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:28.920352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060fd43-65dd-4ff3-808e-3e7c56d12340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:28.920648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060fd43-65dd-4ff3-808e-3e7c56d12340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:28.921568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060fd43-65dd-4ff3-808e-3e7c56d12340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:28.924047 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060fd43-65dd-4ff3-808e-3e7c56d12340 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:28.944990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 966/1946] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:28.949609 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99130c-9283-4cb5-b18e-ac01429ca86d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:28.977005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 981/1947] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:28 2022] POST /identity/v3/projects => generated 378 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:28.982157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060fd43-65dd-4ff3-808e-3e7c56d12340 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:28.995019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99130c-9283-4cb5-b18e-ac01429ca86d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.065446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:29.096297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060fd43-65dd-4ff3-808e-3e7c56d12340 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.109068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99d8a7-4946-4ab3-ad14-120b4314d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.109760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99d8a7-4946-4ab3-ad14-120b4314d728 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.110045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99d8a7-4946-4ab3-ad14-120b4314d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.110326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99d8a7-4946-4ab3-ad14-120b4314d728 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.111080 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99d8a7-4946-4ab3-ad14-120b4314d728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.113117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99d8a7-4946-4ab3-ad14-120b4314d728 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:29.132123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a67fe-c471-4765-83e4-e4c381aded32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.132817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a67fe-c471-4765-83e4-e4c381aded32 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.133294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a67fe-c471-4765-83e4-e4c381aded32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.133849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a67fe-c471-4765-83e4-e4c381aded32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.139079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a67fe-c471-4765-83e4-e4c381aded32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.148999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a67fe-c471-4765-83e4-e4c381aded32 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:29.174033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 982/1948] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:28 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:29.181363 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99d8a7-4946-4ab3-ad14-120b4314d728 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:29.218618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 967/1949] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:28 2022] POST /identity/v3/projects => generated 370 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:29.223167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a67fe-c471-4765-83e4-e4c381aded32 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:29.231952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99d8a7-4946-4ab3-ad14-120b4314d728 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.317653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:29.378713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bf86b-9bae-4ff6-bce8-459ce42353b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.380440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bf86b-9bae-4ff6-bce8-459ce42353b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.380594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bf86b-9bae-4ff6-bce8-459ce42353b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.382045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bf86b-9bae-4ff6-bce8-459ce42353b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.384024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bf86b-9bae-4ff6-bce8-459ce42353b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.386324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bf86b-9bae-4ff6-bce8-459ce42353b1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:29.401139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a67fe-c471-4765-83e4-e4c381aded32 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.405064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 983/1950] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:29 2022] GET /identity/v3/roles => generated 1427 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:29.407595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bf86b-9bae-4ff6-bce8-459ce42353b1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:29.412477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430db1fb-cf4a-4b6f-8aa4-ed6560256bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.413942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430db1fb-cf4a-4b6f-8aa4-ed6560256bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.414380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430db1fb-cf4a-4b6f-8aa4-ed6560256bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.414847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430db1fb-cf4a-4b6f-8aa4-ed6560256bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.415841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430db1fb-cf4a-4b6f-8aa4-ed6560256bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.420036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430db1fb-cf4a-4b6f-8aa4-ed6560256bf6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:29.430352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bf86b-9bae-4ff6-bce8-459ce42353b1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.436121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d7eb-66a1-4c4c-86cd-40fc5a604959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.436898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d7eb-66a1-4c4c-86cd-40fc5a604959 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.437185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d7eb-66a1-4c4c-86cd-40fc5a604959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.437615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417d7eb-66a1-4c4c-86cd-40fc5a604959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.440036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417d7eb-66a1-4c4c-86cd-40fc5a604959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.443820 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417d7eb-66a1-4c4c-86cd-40fc5a604959 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:29.465052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 984/1951] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:29 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:29.470288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d7eb-66a1-4c4c-86cd-40fc5a604959 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:29.472557 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 968/1952] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:29 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:29.476450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430db1fb-cf4a-4b6f-8aa4-ed6560256bf6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:29.498851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430db1fb-cf4a-4b6f-8aa4-ed6560256bf6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.499588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417d7eb-66a1-4c4c-86cd-40fc5a604959 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.512332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00067ff-fdda-4d4e-9bd7-84cfbdf6e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.513355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00067ff-fdda-4d4e-9bd7-84cfbdf6e6bb admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.513738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00067ff-fdda-4d4e-9bd7-84cfbdf6e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.514661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00067ff-fdda-4d4e-9bd7-84cfbdf6e6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.515662 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00067ff-fdda-4d4e-9bd7-84cfbdf6e6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.516455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edc207-2d82-4395-a883-c373bc88d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.517711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edc207-2d82-4395-a883-c373bc88d09b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.518000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edc207-2d82-4395-a883-c373bc88d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.518309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edc207-2d82-4395-a883-c373bc88d09b admin admin] PATH_INFO: `/v3/projects/40dc737f87c8441f904f9116b2157d23/users/2cc80ddd640c40ad8438fe847a0483ff/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.518453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00067ff-fdda-4d4e-9bd7-84cfbdf6e6bb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:29.548890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 969/1953] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:29 2022] GET /identity/v3/roles => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:29.553856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edc207-2d82-4395-a883-c373bc88d09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40dc737f87c8441f904f9116b2157d23, user_id=2cc80ddd640c40ad8438fe847a0483ff, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.555308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00067ff-fdda-4d4e-9bd7-84cfbdf6e6bb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:29.565059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edc207-2d82-4395-a883-c373bc88d09b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:29.570897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00067ff-fdda-4d4e-9bd7-84cfbdf6e6bb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.577636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c4c64-93e4-429c-97eb-fa91d95b6200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.578636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c4c64-93e4-429c-97eb-fa91d95b6200 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.579038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c4c64-93e4-429c-97eb-fa91d95b6200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.579887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c4c64-93e4-429c-97eb-fa91d95b6200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.584722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c4c64-93e4-429c-97eb-fa91d95b6200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.589001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c4c64-93e4-429c-97eb-fa91d95b6200 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:29.592600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 985/1954] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:29 2022] PUT /identity/v3/projects/40dc737f87c8441f904f9116b2157d23/users/2cc80ddd640c40ad8438fe847a0483ff/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:29.606062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b285b1-73a9-4b36-ac33-df9814fa6c4e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.606588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b285b1-73a9-4b36-ac33-df9814fa6c4e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.606865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b285b1-73a9-4b36-ac33-df9814fa6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.613371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 970/1955] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:29 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:29.614332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c4c64-93e4-429c-97eb-fa91d95b6200 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:29.634496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c4c64-93e4-429c-97eb-fa91d95b6200 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.662827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-94b285b1-73a9-4b36-ac33-df9814fa6c4e None None] MFA Rules not processed for user `2cc80ddd640c40ad8438fe847a0483ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:29.665088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-94b285b1-73a9-4b36-ac33-df9814fa6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:29.732589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8177ec-b59a-4ffd-be0d-a5f3eeb48c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.734817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8177ec-b59a-4ffd-be0d-a5f3eeb48c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.735236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8177ec-b59a-4ffd-be0d-a5f3eeb48c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.735700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8177ec-b59a-4ffd-be0d-a5f3eeb48c7e admin admin] PATH_INFO: `/v3/projects/ebdf24c6409d4e7da622a9957eb364a4/users/3a41d202825d4f29945013678ba207eb/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.760225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8177ec-b59a-4ffd-be0d-a5f3eeb48c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdf24c6409d4e7da622a9957eb364a4, user_id=3a41d202825d4f29945013678ba207eb, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.763847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8177ec-b59a-4ffd-be0d-a5f3eeb48c7e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:29.771598 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 986/1956] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:29.776868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b285b1-73a9-4b36-ac33-df9814fa6c4e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:29.792892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b285b1-73a9-4b36-ac33-df9814fa6c4e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:29.794228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 971/1957] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:29 2022] PUT /identity/v3/projects/ebdf24c6409d4e7da622a9957eb364a4/users/3a41d202825d4f29945013678ba207eb/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:29.812639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271336c-0483-4b0b-8c87-20dfd8acbcba None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.812934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271336c-0483-4b0b-8c87-20dfd8acbcba None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.813306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271336c-0483-4b0b-8c87-20dfd8acbcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.850713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8271336c-0483-4b0b-8c87-20dfd8acbcba None None] MFA Rules not processed for user `3a41d202825d4f29945013678ba207eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:29.852161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8271336c-0483-4b0b-8c87-20dfd8acbcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:29.898371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:29.967497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b02d-955e-4185-85f5-c7b8ca0f236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:29.968225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b02d-955e-4185-85f5-c7b8ca0f236c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:29.968509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b02d-955e-4185-85f5-c7b8ca0f236c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:29.968787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b02d-955e-4185-85f5-c7b8ca0f236c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:29.970453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2b02d-955e-4185-85f5-c7b8ca0f236c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:29.971499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2b02d-955e-4185-85f5-c7b8ca0f236c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.026033 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 972/1958] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:30.033171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271336c-0483-4b0b-8c87-20dfd8acbcba None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.034308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 987/1959] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:29 2022] POST /identity/v3/projects => generated 380 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:30.036457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8271336c-0483-4b0b-8c87-20dfd8acbcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:30.038714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b02d-955e-4185-85f5-c7b8ca0f236c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.048973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:30.139412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b02d-955e-4185-85f5-c7b8ca0f236c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.145052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271336c-0483-4b0b-8c87-20dfd8acbcba None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.145610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621012-7a6c-4782-8ca9-d48eb6588a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.146404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621012-7a6c-4782-8ca9-d48eb6588a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.146964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621012-7a6c-4782-8ca9-d48eb6588a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.147582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621012-7a6c-4782-8ca9-d48eb6588a80 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.148664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a621012-7a6c-4782-8ca9-d48eb6588a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:30.150882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a621012-7a6c-4782-8ca9-d48eb6588a80 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.184975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 988/1960] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:30 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:30.190879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621012-7a6c-4782-8ca9-d48eb6588a80 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.202648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621012-7a6c-4782-8ca9-d48eb6588a80 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.210860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a4eca-c424-4d4c-9a28-8b64ab0eb919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.211846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a4eca-c424-4d4c-9a28-8b64ab0eb919 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.212287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a4eca-c424-4d4c-9a28-8b64ab0eb919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.212700 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a4eca-c424-4d4c-9a28-8b64ab0eb919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.213606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a4eca-c424-4d4c-9a28-8b64ab0eb919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:30.215643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a4eca-c424-4d4c-9a28-8b64ab0eb919 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.229458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 989/1961] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:30 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:30.242631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a4eca-c424-4d4c-9a28-8b64ab0eb919 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.253352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a4eca-c424-4d4c-9a28-8b64ab0eb919 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.258121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfe771-66af-44f2-b05c-c537d792e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.259082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfe771-66af-44f2-b05c-c537d792e49a admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.259225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd0559-fa99-4e22-bfd0-6481c0274688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.259787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfe771-66af-44f2-b05c-c537d792e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.259787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfe771-66af-44f2-b05c-c537d792e49a admin admin] PATH_INFO: `/v3/projects/4d53aaa2bb9141c0bf8ba4dad1b41464/users/b7467f5c36fd44fd94a9905f2c646210/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.260167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd0559-fa99-4e22-bfd0-6481c0274688 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.260510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd0559-fa99-4e22-bfd0-6481c0274688 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.260938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd0559-fa99-4e22-bfd0-6481c0274688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.280369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfe771-66af-44f2-b05c-c537d792e49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d53aaa2bb9141c0bf8ba4dad1b41464, user_id=b7467f5c36fd44fd94a9905f2c646210, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:30.285346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfe771-66af-44f2-b05c-c537d792e49a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.306656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 990/1962] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:30 2022] PUT /identity/v3/projects/4d53aaa2bb9141c0bf8ba4dad1b41464/users/b7467f5c36fd44fd94a9905f2c646210/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:30.310565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfe771-66af-44f2-b05c-c537d792e49a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.383821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd0559-fa99-4e22-bfd0-6481c0274688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:30.388101 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd0559-fa99-4e22-bfd0-6481c0274688 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.405603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 973/1963] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:30.428042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfe771-66af-44f2-b05c-c537d792e49a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.436254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689c73c-3631-42e4-9553-864b247558dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.436980 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689c73c-3631-42e4-9553-864b247558dd admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.448554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689c73c-3631-42e4-9553-864b247558dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.448554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689c73c-3631-42e4-9553-864b247558dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.448554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689c73c-3631-42e4-9553-864b247558dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:30.448554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689c73c-3631-42e4-9553-864b247558dd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.448922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd0559-fa99-4e22-bfd0-6481c0274688 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.459394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 991/1964] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:30 2022] GET /identity/v3/roles => generated 1427 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:30.463385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689c73c-3631-42e4-9553-864b247558dd admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.464807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd0559-fa99-4e22-bfd0-6481c0274688 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.473067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:30.478955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689c73c-3631-42e4-9553-864b247558dd admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.480753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.481715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.481997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.482274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] PATH_INFO: `/v3/users/3a41d202825d4f29945013678ba207eb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.484590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a41d202825d4f29945013678ba207eb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:30.487335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.496501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cd5eb-f369-47a5-9685-47c9c381aa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.497551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cd5eb-f369-47a5-9685-47c9c381aa48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.497829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cd5eb-f369-47a5-9685-47c9c381aa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.498233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cd5eb-f369-47a5-9685-47c9c381aa48 admin admin] PATH_INFO: `/v3/projects/4d53aaa2bb9141c0bf8ba4dad1b41464/users/b7467f5c36fd44fd94a9905f2c646210/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.502834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cd5eb-f369-47a5-9685-47c9c381aa48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d53aaa2bb9141c0bf8ba4dad1b41464, user_id=b7467f5c36fd44fd94a9905f2c646210, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:30.507738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cd5eb-f369-47a5-9685-47c9c381aa48 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.533145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 992/1965] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:30 2022] PUT /identity/v3/projects/4d53aaa2bb9141c0bf8ba4dad1b41464/users/b7467f5c36fd44fd94a9905f2c646210/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:30.544927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdb841-9771-4734-ad24-d2adc91b2598 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.545220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdb841-9771-4734-ad24-d2adc91b2598 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.545503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdb841-9771-4734-ad24-d2adc91b2598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.574889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a41d202825d4f29945013678ba207eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.575317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a41d202825d4f29945013678ba207eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.590117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3ccdb841-9771-4734-ad24-d2adc91b2598 None None] MFA Rules not processed for user `b7467f5c36fd44fd94a9905f2c646210`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:30.591386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3ccdb841-9771-4734-ad24-d2adc91b2598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:30.597608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a41d202825d4f29945013678ba207eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.610199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a41d202825d4f29945013678ba207eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.612016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a41d202825d4f29945013678ba207eb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.614298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:30.642156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 974/1966] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:30 2022] DELETE /identity/v3/users/3a41d202825d4f29945013678ba207eb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:30.644355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.646287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:30.690185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 993/1967] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:30.692094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d93ed-8977-4c32-8902-f2bcc4354400 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.692623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d93ed-8977-4c32-8902-f2bcc4354400 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.693230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d93ed-8977-4c32-8902-f2bcc4354400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.721219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cf1d93ed-8977-4c32-8902-f2bcc4354400 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:30.723046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cf1d93ed-8977-4c32-8902-f2bcc4354400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:30.727394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748496d-c274-4214-9025-5ba4ef6ab6a2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.732079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 994/1968] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:30.733273 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d93ed-8977-4c32-8902-f2bcc4354400 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.734743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cf1d93ed-8977-4c32-8902-f2bcc4354400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:30.736528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.737369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.737651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.737928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] PATH_INFO: `/v3/users/a17efb27d51c4703a0cf32fb00485b42` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.739248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17efb27d51c4703a0cf32fb00485b42)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:30.741263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.796235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17efb27d51c4703a0cf32fb00485b42'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.797150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17efb27d51c4703a0cf32fb00485b42'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.808950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d93ed-8977-4c32-8902-f2bcc4354400 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.813251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ebffa-f8e3-4290-9b1f-0bd69c2f5d85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.814199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ebffa-f8e3-4290-9b1f-0bd69c2f5d85 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.814482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ebffa-f8e3-4290-9b1f-0bd69c2f5d85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.814864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ebffa-f8e3-4290-9b1f-0bd69c2f5d85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.816259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17efb27d51c4703a0cf32fb00485b42'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.816951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9e7ebffa-f8e3-4290-9b1f-0bd69c2f5d85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:30.826030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17efb27d51c4703a0cf32fb00485b42'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.826731 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17efb27d51c4703a0cf32fb00485b42'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:30.841354 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 975/1969] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:30 2022] DELETE /identity/v3/users/a17efb27d51c4703a0cf32fb00485b42 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:30.842075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:30.843478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:30.917154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ebffa-f8e3-4290-9b1f-0bd69c2f5d85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:30.918381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ebffa-f8e3-4290-9b1f-0bd69c2f5d85 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:30.925534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad2cfe-ecd2-4946-8fba-f4992da8d2f4 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:30.932605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:30.933710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.934356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.935217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.939854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:30.942598 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 995/1970] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:30.944177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86be39e-3484-4554-83dd-39fa8602e35a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:30.944457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86be39e-3484-4554-83dd-39fa8602e35a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:30.944731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86be39e-3484-4554-83dd-39fa8602e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:30.978231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d86be39e-3484-4554-83dd-39fa8602e35a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:30.979473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d86be39e-3484-4554-83dd-39fa8602e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:30.996380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:31.016300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:31.076343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:31.078986 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:31.112514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 996/1971] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:31.119349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86be39e-3484-4554-83dd-39fa8602e35a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:31.125826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 976/1972] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:31.146737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86be39e-3484-4554-83dd-39fa8602e35a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:31.160921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547239e-20b1-45e7-9c82-542ad105426a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:31.161572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547239e-20b1-45e7-9c82-542ad105426a service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:31.161863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547239e-20b1-45e7-9c82-542ad105426a service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:31.162144 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547239e-20b1-45e7-9c82-542ad105426a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:31.174381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547239e-20b1-45e7-9c82-542ad105426a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:31.176195 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547239e-20b1-45e7-9c82-542ad105426a service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:31.196003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 997/1973] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:31.869548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:31.871851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:31.899185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb7a0f-3683-4998-9919-d2a277c64b41 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:31.905432 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:31.906185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:31.906530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:31.906876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] PATH_INFO: `/v3/projects/ebdf24c6409d4e7da622a9957eb364a4` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:31.908411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdf24c6409d4e7da622a9957eb364a4)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:31.910424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:31.965042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdf24c6409d4e7da622a9957eb364a4', 'request_id': 'req-66db4b71-3ff6-422f-ac0f-f957d36aa62f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:31.973296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdf24c6409d4e7da622a9957eb364a4', 'request_id': 'req-66db4b71-3ff6-422f-ac0f-f957d36aa62f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:31.982729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdf24c6409d4e7da622a9957eb364a4', 'request_id': 'req-66db4b71-3ff6-422f-ac0f-f957d36aa62f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:31.994204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] The token cache is being invalidate because project ebdf24c6409d4e7da622a9957eb364a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:31.994452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:31.995513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-66db4b71-3ff6-422f-ac0f-f957d36aa62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:31.997194 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 977/1974] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:31 2022] DELETE /identity/v3/projects/ebdf24c6409d4e7da622a9957eb364a4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:32.002568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6192c7-6333-434a-b8c3-e3411899e695 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.002954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6192c7-6333-434a-b8c3-e3411899e695 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.003194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6192c7-6333-434a-b8c3-e3411899e695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.022686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3c6192c7-6333-434a-b8c3-e3411899e695 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:32.024012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3c6192c7-6333-434a-b8c3-e3411899e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:32.092806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 998/1975] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:32.101063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7e22-eac9-49fa-8dce-b6a333ba7ecd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.101355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7e22-eac9-49fa-8dce-b6a333ba7ecd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.101635 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7e22-eac9-49fa-8dce-b6a333ba7ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.121272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ee2a7e22-eac9-49fa-8dce-b6a333ba7ecd None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:32.122492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ee2a7e22-eac9-49fa-8dce-b6a333ba7ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:32.130492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 978/1976] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:32.135468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6192c7-6333-434a-b8c3-e3411899e695 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.146126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6192c7-6333-434a-b8c3-e3411899e695 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.150990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769babd-015c-46a6-bae3-d83c25dbe82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.152210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769babd-015c-46a6-bae3-d83c25dbe82d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.152210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769babd-015c-46a6-bae3-d83c25dbe82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.152210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769babd-015c-46a6-bae3-d83c25dbe82d admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.152919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769babd-015c-46a6-bae3-d83c25dbe82d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:32.153227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769babd-015c-46a6-bae3-d83c25dbe82d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.154853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769babd-015c-46a6-bae3-d83c25dbe82d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.181325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 999/1977] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:32.187343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a7e22-eac9-49fa-8dce-b6a333ba7ecd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.200068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a7e22-eac9-49fa-8dce-b6a333ba7ecd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.206534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6a3e-413f-46e4-889d-87e659883f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.208657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6a3e-413f-46e4-889d-87e659883f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.208657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6a3e-413f-46e4-889d-87e659883f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.208657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6a3e-413f-46e4-889d-87e659883f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.209451 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd6a3e-413f-46e4-889d-87e659883f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.211463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd6a3e-413f-46e4-889d-87e659883f6d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.255695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 979/1978] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:32 2022] POST /identity/v3/projects => generated 398 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:32.257217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769babd-015c-46a6-bae3-d83c25dbe82d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.271014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769babd-015c-46a6-bae3-d83c25dbe82d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.345945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64622026-1335-4e63-aaa2-fa76e4b18989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.346542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64622026-1335-4e63-aaa2-fa76e4b18989 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.346828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64622026-1335-4e63-aaa2-fa76e4b18989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.347108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64622026-1335-4e63-aaa2-fa76e4b18989 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.347829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64622026-1335-4e63-aaa2-fa76e4b18989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.349922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64622026-1335-4e63-aaa2-fa76e4b18989 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.380083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1000/1979] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:32 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:32.381789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6a3e-413f-46e4-889d-87e659883f6d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.393007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6a3e-413f-46e4-889d-87e659883f6d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.397754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d41fa2-fad2-4f07-a375-649164e1e351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.398419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41fa2-fad2-4f07-a375-649164e1e351 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.398701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41fa2-fad2-4f07-a375-649164e1e351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.399010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41fa2-fad2-4f07-a375-649164e1e351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.400692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d41fa2-fad2-4f07-a375-649164e1e351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.402322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d41fa2-fad2-4f07-a375-649164e1e351 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.413238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 980/1980] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:32 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:32.417213 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64622026-1335-4e63-aaa2-fa76e4b18989 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.427994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64622026-1335-4e63-aaa2-fa76e4b18989 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.432799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d753bb-9ca6-4d6d-abe2-6c8aa99e4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.433564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d753bb-9ca6-4d6d-abe2-6c8aa99e4300 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.433854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d753bb-9ca6-4d6d-abe2-6c8aa99e4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.434130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d753bb-9ca6-4d6d-abe2-6c8aa99e4300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.434860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d753bb-9ca6-4d6d-abe2-6c8aa99e4300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.435049 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d41fa2-fad2-4f07-a375-649164e1e351 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.436513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d753bb-9ca6-4d6d-abe2-6c8aa99e4300 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.437872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-29d41fa2-fad2-4f07-a375-649164e1e351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:32.449039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1001/1981] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:32 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:32.452348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d41fa2-fad2-4f07-a375-649164e1e351 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.452999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d753bb-9ca6-4d6d-abe2-6c8aa99e4300 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.457848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.459375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.460555 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.461666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] PATH_INFO: `/v3/projects/678c742869ba4fc683d61900af5728df` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.465535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d753bb-9ca6-4d6d-abe2-6c8aa99e4300 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.473594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d390-fd85-49bc-809a-7e5b6773bbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.473710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=678c742869ba4fc683d61900af5728df)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.474728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d390-fd85-49bc-809a-7e5b6773bbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.475087 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d390-fd85-49bc-809a-7e5b6773bbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.475444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d390-fd85-49bc-809a-7e5b6773bbeb admin admin] PATH_INFO: `/v3/projects/2fb0a2a792cd48b09c8a092529f234b9/users/59146db3bed743aab4224fa5bd576fdb/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.491003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.501995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789d390-fd85-49bc-809a-7e5b6773bbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb0a2a792cd48b09c8a092529f234b9, user_id=59146db3bed743aab4224fa5bd576fdb, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.507293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789d390-fd85-49bc-809a-7e5b6773bbeb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.510762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:32.526480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1002/1982] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:32 2022] PUT /identity/v3/projects/2fb0a2a792cd48b09c8a092529f234b9/users/59146db3bed743aab4224fa5bd576fdb/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:32.539385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d0fe-7771-4d6a-9c8b-f84cce03bd09 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.539714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d0fe-7771-4d6a-9c8b-f84cce03bd09 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.540118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d0fe-7771-4d6a-9c8b-f84cce03bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.574359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dd04d0fe-7771-4d6a-9c8b-f84cce03bd09 None None] MFA Rules not processed for user `59146db3bed743aab4224fa5bd576fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:32.575860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dd04d0fe-7771-4d6a-9c8b-f84cce03bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:32.584584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '678c742869ba4fc683d61900af5728df', 'request_id': 'req-af928188-cac0-4855-8ae7-b24f4b4e0333'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.593107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '678c742869ba4fc683d61900af5728df', 'request_id': 'req-af928188-cac0-4855-8ae7-b24f4b4e0333'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.597875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:32.606565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '678c742869ba4fc683d61900af5728df', 'request_id': 'req-af928188-cac0-4855-8ae7-b24f4b4e0333'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.647325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] The token cache is being invalidate because project 678c742869ba4fc683d61900af5728df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:32.647671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.648956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.653494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 981/1983] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:32 2022] DELETE /identity/v3/projects/678c742869ba4fc683d61900af5728df => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:32.653494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.656695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:32.703342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1003/1984] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:32.704685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04d0fe-7771-4d6a-9c8b-f84cce03bd09 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.706866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dd04d0fe-7771-4d6a-9c8b-f84cce03bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:32.746855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af928188-cac0-4855-8ae7-b24f4b4e0333 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.759413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.759413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.759413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.759413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.760255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:32.793065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04d0fe-7771-4d6a-9c8b-f84cce03bd09 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.801238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.802249 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.802612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.802970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] PATH_INFO: `/v3/users/ed21f645bf5946e88829296126e8b4a9` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.804899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed21f645bf5946e88829296126e8b4a9)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.807205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.860580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.863829 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.878562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed21f645bf5946e88829296126e8b4a9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.879372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed21f645bf5946e88829296126e8b4a9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.883299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 982/1985] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:32.885182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:32.888849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed21f645bf5946e88829296126e8b4a9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.889353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:32.889847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed21f645bf5946e88829296126e8b4a9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.914536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed21f645bf5946e88829296126e8b4a9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:32.916680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd462c-fccc-41fc-97d0-236e79fabbdc service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:32.924121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56368e-f428-498e-acf2-523e1643cf50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:32.924907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56368e-f428-498e-acf2-523e1643cf50 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:32.925225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56368e-f428-498e-acf2-523e1643cf50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:32.926182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56368e-f428-498e-acf2-523e1643cf50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:32.930134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1c56368e-f428-498e-acf2-523e1643cf50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:32.950962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56368e-f428-498e-acf2-523e1643cf50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:32.952450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56368e-f428-498e-acf2-523e1643cf50 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:32.953576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1004/1986] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:32 2022] DELETE /identity/v3/users/ed21f645bf5946e88829296126e8b4a9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:32.988136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 983/1987] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:33.487233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:33.488974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:33.506078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:33.686097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545243-69dd-445b-b07b-10e48f87fcc3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:33.693106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:33.694173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:33.694561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:33.694947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] PATH_INFO: `/v3/projects/3ce7c65b42e84abfaf147695aa103474` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:33.696472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce7c65b42e84abfaf147695aa103474)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:33.698585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:33.791774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce7c65b42e84abfaf147695aa103474', 'request_id': 'req-b4996500-fa44-4a55-9fc5-a78019417787'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:33.803332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce7c65b42e84abfaf147695aa103474', 'request_id': 'req-b4996500-fa44-4a55-9fc5-a78019417787'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:33.823780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce7c65b42e84abfaf147695aa103474', 'request_id': 'req-b4996500-fa44-4a55-9fc5-a78019417787'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:33.845478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] The token cache is being invalidate because project 3ce7c65b42e84abfaf147695aa103474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:33.845865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:33.846619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b4996500-fa44-4a55-9fc5-a78019417787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:33.851609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1005/1988] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:33 2022] DELETE /identity/v3/projects/3ce7c65b42e84abfaf147695aa103474 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:33.854303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df25e9-c668-4e95-ab9b-be4a7219802f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:33.854599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df25e9-c668-4e95-ab9b-be4a7219802f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:33.854876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df25e9-c668-4e95-ab9b-be4a7219802f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:33.876530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a3df25e9-c668-4e95-ab9b-be4a7219802f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:33.877957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a3df25e9-c668-4e95-ab9b-be4a7219802f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:34.027598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 984/1989] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:34.032153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd4caa-8a65-4a38-978e-a71b3ec4b9f1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.033048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd4caa-8a65-4a38-978e-a71b3ec4b9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.033335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd4caa-8a65-4a38-978e-a71b3ec4b9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.071071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-73cd4caa-8a65-4a38-978e-a71b3ec4b9f1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:34.077408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-73cd4caa-8a65-4a38-978e-a71b3ec4b9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:34.103736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1006/1990] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:34.104649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df25e9-c668-4e95-ab9b-be4a7219802f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:34.115542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df25e9-c668-4e95-ab9b-be4a7219802f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:34.120585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d7898-2c7d-4986-84f5-c71c1d33bab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:34.121260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7898-2c7d-4986-84f5-c71c1d33bab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.121544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7898-2c7d-4986-84f5-c71c1d33bab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.122000 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d7898-2c7d-4986-84f5-c71c1d33bab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.122790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d7898-2c7d-4986-84f5-c71c1d33bab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:34.123102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d7898-2c7d-4986-84f5-c71c1d33bab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:34.124758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d7898-2c7d-4986-84f5-c71c1d33bab9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:34.172570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 985/1991] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:28:34.177090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd4caa-8a65-4a38-978e-a71b3ec4b9f1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:34.190433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd4caa-8a65-4a38-978e-a71b3ec4b9f1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:34.206247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedc3ac-a9a3-4b51-bf06-d3ac3753076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:34.207356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedc3ac-a9a3-4b51-bf06-d3ac3753076c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.207823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedc3ac-a9a3-4b51-bf06-d3ac3753076c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.208252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedc3ac-a9a3-4b51-bf06-d3ac3753076c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.209888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedc3ac-a9a3-4b51-bf06-d3ac3753076c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:34.213027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedc3ac-a9a3-4b51-bf06-d3ac3753076c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:34.256172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1007/1992] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:34 2022] POST /identity/v3/projects => generated 368 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:34.262017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d7898-2c7d-4986-84f5-c71c1d33bab9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:34.281063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d7898-2c7d-4986-84f5-c71c1d33bab9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:34.296219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:34.411291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad79cbe-8085-4614-b0ea-b27568fab9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:34.412377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad79cbe-8085-4614-b0ea-b27568fab9af admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.412938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad79cbe-8085-4614-b0ea-b27568fab9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.413809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad79cbe-8085-4614-b0ea-b27568fab9af admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.414875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad79cbe-8085-4614-b0ea-b27568fab9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:34.419647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad79cbe-8085-4614-b0ea-b27568fab9af admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:34.455623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 986/1993] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:34 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:34.458670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedc3ac-a9a3-4b51-bf06-d3ac3753076c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:34.478022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedc3ac-a9a3-4b51-bf06-d3ac3753076c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:34.491507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931c459-2334-4b45-a7f7-cf211885be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:34.493102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931c459-2334-4b45-a7f7-cf211885be37 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.493493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931c459-2334-4b45-a7f7-cf211885be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.493903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931c459-2334-4b45-a7f7-cf211885be37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.495340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931c459-2334-4b45-a7f7-cf211885be37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:34.498425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931c459-2334-4b45-a7f7-cf211885be37 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:34.531155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1008/1994] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:34 2022] GET /identity/v3/roles => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:34.535717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad79cbe-8085-4614-b0ea-b27568fab9af admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:34.558490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad79cbe-8085-4614-b0ea-b27568fab9af admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:34.572823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d38ab7-598a-41c0-865b-bf226b69b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:34.573519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38ab7-598a-41c0-865b-bf226b69b59c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.574001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38ab7-598a-41c0-865b-bf226b69b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.574285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38ab7-598a-41c0-865b-bf226b69b59c admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.575027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d38ab7-598a-41c0-865b-bf226b69b59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:34.578930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d38ab7-598a-41c0-865b-bf226b69b59c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:34.611827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 987/1995] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:34 2022] GET /identity/v3/roles => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:34.613921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931c459-2334-4b45-a7f7-cf211885be37 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:34.628746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931c459-2334-4b45-a7f7-cf211885be37 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:34.634402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c951f-439f-46f6-a559-8e368aa3100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:34.635830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c951f-439f-46f6-a559-8e368aa3100d admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.636329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c951f-439f-46f6-a559-8e368aa3100d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.637238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c951f-439f-46f6-a559-8e368aa3100d admin admin] PATH_INFO: `/v3/projects/6ec74746ec8c4a94883569d1a2348442/users/60ccf030876e4d57b116e73139b4e857/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.653532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa982e-b65e-4df0-8fe8-e77f95f7ef6f None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.653833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa982e-b65e-4df0-8fe8-e77f95f7ef6f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.654108 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa982e-b65e-4df0-8fe8-e77f95f7ef6f None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.656281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 988/1996] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:28:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:28:34.659426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c951f-439f-46f6-a559-8e368aa3100d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec74746ec8c4a94883569d1a2348442, user_id=60ccf030876e4d57b116e73139b4e857, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:34.663927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c951f-439f-46f6-a559-8e368aa3100d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:34.685231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1009/1997] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:34 2022] PUT /identity/v3/projects/6ec74746ec8c4a94883569d1a2348442/users/60ccf030876e4d57b116e73139b4e857/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:34.697540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485a67-f00c-451c-b0e9-d139b3af168d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.698000 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485a67-f00c-451c-b0e9-d139b3af168d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.698290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485a67-f00c-451c-b0e9-d139b3af168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.743356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926a982-2b89-436c-aa24-58006ab6849c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.743686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926a982-2b89-436c-aa24-58006ab6849c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.743955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926a982-2b89-436c-aa24-58006ab6849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.799148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7926a982-2b89-436c-aa24-58006ab6849c None None] MFA Rules not processed for user `88e5d3ba49164f55a063aa60643bd421`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:34.803017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7926a982-2b89-436c-aa24-58006ab6849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:34.806444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8d485a67-f00c-451c-b0e9-d139b3af168d None None] MFA Rules not processed for user `60ccf030876e4d57b116e73139b4e857`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:34.807939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8d485a67-f00c-451c-b0e9-d139b3af168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:34.857198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:34.916491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1010/1998] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:28:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:34.917305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926a982-2b89-436c-aa24-58006ab6849c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:34.918638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7926a982-2b89-436c-aa24-58006ab6849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:34.937964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 989/1999] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:34.939512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485a67-f00c-451c-b0e9-d139b3af168d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:34.942288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8d485a67-f00c-451c-b0e9-d139b3af168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:34.975454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485a67-f00c-451c-b0e9-d139b3af168d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:34.982239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f5963-8c37-4eb8-86c3-c52188b802d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:34.982899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f5963-8c37-4eb8-86c3-c52188b802d2 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:34.983181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f5963-8c37-4eb8-86c3-c52188b802d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:34.983459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f5963-8c37-4eb8-86c3-c52188b802d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:34.994085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f5963-8c37-4eb8-86c3-c52188b802d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:34.996236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f5963-8c37-4eb8-86c3-c52188b802d2 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.009989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 990/2000] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:35.010952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f5963-8c37-4eb8-86c3-c52188b802d2 service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.018050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926a982-2b89-436c-aa24-58006ab6849c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.024372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.025581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.026035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.026464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] PATH_INFO: `/v3/users/c8790c1f6da34ce3901a536ba76ae6b5` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.027909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8790c1f6da34ce3901a536ba76ae6b5)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.028680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f5963-8c37-4eb8-86c3-c52188b802d2 service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.030975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.037885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825b26-fe58-4c50-9399-afc12e36d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.039926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825b26-fe58-4c50-9399-afc12e36d8bb admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.040332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825b26-fe58-4c50-9399-afc12e36d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.040715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825b26-fe58-4c50-9399-afc12e36d8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.041549 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09825b26-fe58-4c50-9399-afc12e36d8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.044960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09825b26-fe58-4c50-9399-afc12e36d8bb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.082886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 991/2001] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:35 2022] POST /identity/v3/projects => generated 364 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:35.087765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825b26-fe58-4c50-9399-afc12e36d8bb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.093168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8790c1f6da34ce3901a536ba76ae6b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.094008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8790c1f6da34ce3901a536ba76ae6b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.104467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8790c1f6da34ce3901a536ba76ae6b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.105321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8790c1f6da34ce3901a536ba76ae6b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.118353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8790c1f6da34ce3901a536ba76ae6b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.154938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:35.168415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1011/2002] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:34 2022] DELETE /identity/v3/users/c8790c1f6da34ce3901a536ba76ae6b5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:35.201123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825b26-fe58-4c50-9399-afc12e36d8bb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.289844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2119c1-3914-4760-8f73-41bdb74f0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.290660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2119c1-3914-4760-8f73-41bdb74f0014 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.290940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2119c1-3914-4760-8f73-41bdb74f0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.291211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2119c1-3914-4760-8f73-41bdb74f0014 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.291965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2119c1-3914-4760-8f73-41bdb74f0014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.294322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2119c1-3914-4760-8f73-41bdb74f0014 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.326457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 992/2003] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:35 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:35.331622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.333463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:35.349291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419a315-ad60-4a08-80fa-9c3cb1fa87dd admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.354124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306c3d7-c634-474f-b953-24e5422ef507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.354870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306c3d7-c634-474f-b953-24e5422ef507 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.355076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306c3d7-c634-474f-b953-24e5422ef507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.355355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306c3d7-c634-474f-b953-24e5422ef507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.356388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306c3d7-c634-474f-b953-24e5422ef507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.358011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306c3d7-c634-474f-b953-24e5422ef507 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.370355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1012/2004] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:35 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:35.375716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2119c1-3914-4760-8f73-41bdb74f0014 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.388631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2119c1-3914-4760-8f73-41bdb74f0014 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.393640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306c3d7-c634-474f-b953-24e5422ef507 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.395368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2306c3d7-c634-474f-b953-24e5422ef507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:35.397613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd109874-d169-4f7b-a06b-953d188b9769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.399000 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd109874-d169-4f7b-a06b-953d188b9769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.399510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd109874-d169-4f7b-a06b-953d188b9769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.400001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd109874-d169-4f7b-a06b-953d188b9769 admin admin] PATH_INFO: `/v3/projects/8e15cdbc8aa9485aa6f1b27e340a35a6/users/eb6d64b30f504b95b27ad1d0a81be477/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.413310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306c3d7-c634-474f-b953-24e5422ef507 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.421037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd109874-d169-4f7b-a06b-953d188b9769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e15cdbc8aa9485aa6f1b27e340a35a6, user_id=eb6d64b30f504b95b27ad1d0a81be477, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.423829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.424966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd109874-d169-4f7b-a06b-953d188b9769 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.425708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.426581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.427091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] PATH_INFO: `/v3/projects/c41904d347744ff795658fc78c439ebe` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.430271 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41904d347744ff795658fc78c439ebe)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.433726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.453893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 993/2005] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:35 2022] PUT /identity/v3/projects/8e15cdbc8aa9485aa6f1b27e340a35a6/users/eb6d64b30f504b95b27ad1d0a81be477/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:35.458150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd109874-d169-4f7b-a06b-953d188b9769 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.476798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:35.498025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41904d347744ff795658fc78c439ebe', 'request_id': 'req-b952c549-7be4-400f-93df-29a45949f5c0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.505934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41904d347744ff795658fc78c439ebe', 'request_id': 'req-b952c549-7be4-400f-93df-29a45949f5c0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.514692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41904d347744ff795658fc78c439ebe', 'request_id': 'req-b952c549-7be4-400f-93df-29a45949f5c0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.527098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] The token cache is being invalidate because project c41904d347744ff795658fc78c439ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:35.527517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.528297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b952c549-7be4-400f-93df-29a45949f5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:35.530097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1013/2006] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:35 2022] DELETE /identity/v3/projects/c41904d347744ff795658fc78c439ebe => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:35.533962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd109874-d169-4f7b-a06b-953d188b9769 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.534910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e369c-30e8-4e8a-bfc9-735b1732bf54 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.535194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e369c-30e8-4e8a-bfc9-735b1732bf54 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.535468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e369c-30e8-4e8a-bfc9-735b1732bf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.556821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-029e369c-30e8-4e8a-bfc9-735b1732bf54 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:35.558210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-029e369c-30e8-4e8a-bfc9-735b1732bf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:35.621718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40381d5a-0734-4410-ae1e-6d52fa9a4e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.622395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40381d5a-0734-4410-ae1e-6d52fa9a4e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.622824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40381d5a-0734-4410-ae1e-6d52fa9a4e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.622945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40381d5a-0734-4410-ae1e-6d52fa9a4e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.623715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40381d5a-0734-4410-ae1e-6d52fa9a4e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.625341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40381d5a-0734-4410-ae1e-6d52fa9a4e7b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.631685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:35.636954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1014/2007] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:35.638553 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 994/2008] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:35 2022] GET /identity/v3/roles => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:35.645120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40381d5a-0734-4410-ae1e-6d52fa9a4e7b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.645328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d1308-720d-4b80-a305-9587586bc2a1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.645480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d1308-720d-4b80-a305-9587586bc2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.645768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d1308-720d-4b80-a305-9587586bc2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.648518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-40381d5a-0734-4410-ae1e-6d52fa9a4e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:35.663461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40381d5a-0734-4410-ae1e-6d52fa9a4e7b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.665297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7e0d1308-720d-4b80-a305-9587586bc2a1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:35.666790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7e0d1308-720d-4b80-a305-9587586bc2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:35.668738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba6a29-38cf-4cf9-8d74-33fda242fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.669796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6a29-38cf-4cf9-8d74-33fda242fdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.670121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6a29-38cf-4cf9-8d74-33fda242fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.670373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6a29-38cf-4cf9-8d74-33fda242fdd8 admin admin] PATH_INFO: `/v3/projects/8e15cdbc8aa9485aa6f1b27e340a35a6/users/eb6d64b30f504b95b27ad1d0a81be477/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.672547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba6a29-38cf-4cf9-8d74-33fda242fdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e15cdbc8aa9485aa6f1b27e340a35a6, user_id=eb6d64b30f504b95b27ad1d0a81be477, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.676251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba6a29-38cf-4cf9-8d74-33fda242fdd8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.678893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1015/2009] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:35.683008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d1308-720d-4b80-a305-9587586bc2a1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.689551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 995/2010] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:35 2022] PUT /identity/v3/projects/8e15cdbc8aa9485aa6f1b27e340a35a6/users/eb6d64b30f504b95b27ad1d0a81be477/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:35.694146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d1308-720d-4b80-a305-9587586bc2a1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.701662 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45e1c-4a50-4d64-8d77-4fb2ed813382 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.702015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45e1c-4a50-4d64-8d77-4fb2ed813382 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.702296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b45e1c-4a50-4d64-8d77-4fb2ed813382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.737977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-80b45e1c-4a50-4d64-8d77-4fb2ed813382 None None] MFA Rules not processed for user `eb6d64b30f504b95b27ad1d0a81be477`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:35.739341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-80b45e1c-4a50-4d64-8d77-4fb2ed813382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:35.773217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c6eb9-e51f-483a-bac7-a476f838bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.773895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c6eb9-e51f-483a-bac7-a476f838bcbc admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.774184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c6eb9-e51f-483a-bac7-a476f838bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.774462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c6eb9-e51f-483a-bac7-a476f838bcbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.775191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c6eb9-e51f-483a-bac7-a476f838bcbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:35.775498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c6eb9-e51f-483a-bac7-a476f838bcbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.777135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c6eb9-e51f-483a-bac7-a476f838bcbc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.790059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1016/2011] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:28:35.794421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c6eb9-e51f-483a-bac7-a476f838bcbc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.805234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c6eb9-e51f-483a-bac7-a476f838bcbc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.810083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f61fb-5c0b-4e59-897f-1a2e209d7b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.810725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f61fb-5c0b-4e59-897f-1a2e209d7b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.811009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f61fb-5c0b-4e59-897f-1a2e209d7b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.811288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f61fb-5c0b-4e59-897f-1a2e209d7b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.812020 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f61fb-5c0b-4e59-897f-1a2e209d7b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.814597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f61fb-5c0b-4e59-897f-1a2e209d7b0a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.817740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 996/2012] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:35.831030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b45e1c-4a50-4d64-8d77-4fb2ed813382 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.834456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-80b45e1c-4a50-4d64-8d77-4fb2ed813382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:35.851602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1017/2013] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:35 2022] POST /identity/v3/projects => generated 366 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:35.855730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f61fb-5c0b-4e59-897f-1a2e209d7b0a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:35.890524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:35.915289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b45e1c-4a50-4d64-8d77-4fb2ed813382 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.936787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f61fb-5c0b-4e59-897f-1a2e209d7b0a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:35.942077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e09f74-ca22-4fe3-9262-970fae48c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.942870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e09f74-ca22-4fe3-9262-970fae48c238 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.943210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e09f74-ca22-4fe3-9262-970fae48c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.943590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e09f74-ca22-4fe3-9262-970fae48c238 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.944397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e09f74-ca22-4fe3-9262-970fae48c238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:35.946441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e09f74-ca22-4fe3-9262-970fae48c238 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:35.975208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618fd26-bb59-4b05-84be-70363fc25056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:35.975961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618fd26-bb59-4b05-84be-70363fc25056 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:35.976826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618fd26-bb59-4b05-84be-70363fc25056 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:35.977012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618fd26-bb59-4b05-84be-70363fc25056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:35.986788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1018/2014] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:35 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:35.988821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e09f74-ca22-4fe3-9262-970fae48c238 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:36.002927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e09f74-ca22-4fe3-9262-970fae48c238 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:36.011400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586df4e2-dc78-4919-9654-9358094ecbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:36.014638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df4e2-dc78-4919-9654-9358094ecbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:36.015814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df4e2-dc78-4919-9654-9358094ecbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:36.017261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df4e2-dc78-4919-9654-9358094ecbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:36.031346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586df4e2-dc78-4919-9654-9358094ecbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:36.033661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586df4e2-dc78-4919-9654-9358094ecbc0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:36.049457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1019/2015] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:35 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:36.053634 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586df4e2-dc78-4919-9654-9358094ecbc0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:36.058499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:36.080327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586df4e2-dc78-4919-9654-9358094ecbc0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:36.094132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a406ec-a8b1-4130-ab28-dbe0cd79797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:36.096003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a406ec-a8b1-4130-ab28-dbe0cd79797b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:36.096003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a406ec-a8b1-4130-ab28-dbe0cd79797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:36.096352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a406ec-a8b1-4130-ab28-dbe0cd79797b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:36.097323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a406ec-a8b1-4130-ab28-dbe0cd79797b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:36.099454 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a406ec-a8b1-4130-ab28-dbe0cd79797b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:36.115841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1020/2016] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:36 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:36.117792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a406ec-a8b1-4130-ab28-dbe0cd79797b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:36.129955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a406ec-a8b1-4130-ab28-dbe0cd79797b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:36.131412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618fd26-bb59-4b05-84be-70363fc25056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:36.132966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618fd26-bb59-4b05-84be-70363fc25056 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:36.139837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58ad9f-ed7a-4d00-802c-b35ea587afbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:36.141972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58ad9f-ed7a-4d00-802c-b35ea587afbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:36.142316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58ad9f-ed7a-4d00-802c-b35ea587afbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:36.142615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58ad9f-ed7a-4d00-802c-b35ea587afbd admin admin] PATH_INFO: `/v3/projects/9e8f7fb3b31f4f2ba545182786d6d837/users/179b2dea45364fb99731a2ee40c42d95/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:36.144580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 997/2017] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:36.188713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58ad9f-ed7a-4d00-802c-b35ea587afbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8f7fb3b31f4f2ba545182786d6d837, user_id=179b2dea45364fb99731a2ee40c42d95, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:36.200928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58ad9f-ed7a-4d00-802c-b35ea587afbd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:36.220515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1021/2018] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:36 2022] PUT /identity/v3/projects/9e8f7fb3b31f4f2ba545182786d6d837/users/179b2dea45364fb99731a2ee40c42d95/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:36.233099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14c4a2-b656-430f-86d6-e1be236d35fa None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:36.233388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14c4a2-b656-430f-86d6-e1be236d35fa None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:36.233664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14c4a2-b656-430f-86d6-e1be236d35fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:36.257950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58ad9f-ed7a-4d00-802c-b35ea587afbd admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:36.267275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5e14c4a2-b656-430f-86d6-e1be236d35fa None None] MFA Rules not processed for user `179b2dea45364fb99731a2ee40c42d95`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:36.269006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5e14c4a2-b656-430f-86d6-e1be236d35fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:36.334260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58ad9f-ed7a-4d00-802c-b35ea587afbd admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:36.338847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c1114-dbb5-47d4-8ca3-5f5956aca0a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:36.339891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c1114-dbb5-47d4-8ca3-5f5956aca0a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:36.340249 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c1114-dbb5-47d4-8ca3-5f5956aca0a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:36.340538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c1114-dbb5-47d4-8ca3-5f5956aca0a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:36.343005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-af6c1114-dbb5-47d4-8ca3-5f5956aca0a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:36.362800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 998/2019] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:36.375942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14c4a2-b656-430f-86d6-e1be236d35fa None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:36.377942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5e14c4a2-b656-430f-86d6-e1be236d35fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:36.390838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14c4a2-b656-430f-86d6-e1be236d35fa None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:36.395757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb08c8-54a6-429d-9b16-9168ec167684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:36.396957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb08c8-54a6-429d-9b16-9168ec167684 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:36.396957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb08c8-54a6-429d-9b16-9168ec167684 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:36.397770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb08c8-54a6-429d-9b16-9168ec167684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:36.409997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb08c8-54a6-429d-9b16-9168ec167684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:36.411750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb08c8-54a6-429d-9b16-9168ec167684 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:36.419942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c1114-dbb5-47d4-8ca3-5f5956aca0a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:36.421402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c1114-dbb5-47d4-8ca3-5f5956aca0a2 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:36.422218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 999/2020] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:36.433823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1022/2021] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:37.164760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb08c8-54a6-429d-9b16-9168ec167684 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:37.166334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-77cb08c8-54a6-429d-9b16-9168ec167684 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:37.241267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb08c8-54a6-429d-9b16-9168ec167684 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:37.246288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:37.247145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:37.247424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:37.247741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] PATH_INFO: `/v3/users/2cc80ddd640c40ad8438fe847a0483ff` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:37.248949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc80ddd640c40ad8438fe847a0483ff)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:37.251842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:37.316877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc80ddd640c40ad8438fe847a0483ff'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:37.317582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc80ddd640c40ad8438fe847a0483ff'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:37.328779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:37.337455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc80ddd640c40ad8438fe847a0483ff'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:37.345910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc80ddd640c40ad8438fe847a0483ff'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:37.346904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc80ddd640c40ad8438fe847a0483ff'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:37.369831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1000/2022] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:37 2022] DELETE /identity/v3/users/2cc80ddd640c40ad8438fe847a0483ff => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:37.376344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3983ddc-dc02-4f53-9a5c-2bbdefde3efc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:37.376957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3983ddc-dc02-4f53-9a5c-2bbdefde3efc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:37.377112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3983ddc-dc02-4f53-9a5c-2bbdefde3efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:37.400958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f3983ddc-dc02-4f53-9a5c-2bbdefde3efc None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:37.402279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f3983ddc-dc02-4f53-9a5c-2bbdefde3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:37.432709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:37.482939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1023/2023] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:37.492666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:37.494085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:37.553219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586551-f761-4f02-9455-7605b10f5d86 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:37.557502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e0d1b-2939-42b8-b93e-39ae40484885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:37.558154 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e0d1b-2939-42b8-b93e-39ae40484885 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:37.558439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e0d1b-2939-42b8-b93e-39ae40484885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:37.558724 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e0d1b-2939-42b8-b93e-39ae40484885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:37.568655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e0d1b-2939-42b8-b93e-39ae40484885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:37.570096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e0d1b-2939-42b8-b93e-39ae40484885 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:37.579566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1001/2024] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:37.857044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3983ddc-dc02-4f53-9a5c-2bbdefde3efc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:37.859495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f3983ddc-dc02-4f53-9a5c-2bbdefde3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:37.874142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3983ddc-dc02-4f53-9a5c-2bbdefde3efc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:37.880772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:37.881985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:37.882479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:37.882941 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] PATH_INFO: `/v3/projects/40dc737f87c8441f904f9116b2157d23` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:37.884407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=40dc737f87c8441f904f9116b2157d23)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:37.886551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:37.972584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40dc737f87c8441f904f9116b2157d23', 'request_id': 'req-434b0c74-7cee-482b-86ef-8f4786adf4cc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:37.980083 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40dc737f87c8441f904f9116b2157d23', 'request_id': 'req-434b0c74-7cee-482b-86ef-8f4786adf4cc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:37.990252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40dc737f87c8441f904f9116b2157d23', 'request_id': 'req-434b0c74-7cee-482b-86ef-8f4786adf4cc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.004887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] The token cache is being invalidate because project 40dc737f87c8441f904f9116b2157d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:38.005081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.005913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.015994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1024/2025] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:37 2022] DELETE /identity/v3/projects/40dc737f87c8441f904f9116b2157d23 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:38.020533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e0d1b-2939-42b8-b93e-39ae40484885 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:38.033383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e0d1b-2939-42b8-b93e-39ae40484885 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:38.119314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:38.120498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:38.120931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:38.121402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] PATH_INFO: `/v3/users/b7467f5c36fd44fd94a9905f2c646210` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:38.123088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7467f5c36fd44fd94a9905f2c646210)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:38.125410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:38.197336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7467f5c36fd44fd94a9905f2c646210'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.198151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7467f5c36fd44fd94a9905f2c646210'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.222830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7467f5c36fd44fd94a9905f2c646210'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.236729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7467f5c36fd44fd94a9905f2c646210'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.237634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-67204754-9b48-4068-b993-b72f2c3e1d09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7467f5c36fd44fd94a9905f2c646210'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.242659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:38.262746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1002/2026] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:38 2022] DELETE /identity/v3/users/b7467f5c36fd44fd94a9905f2c646210 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:38.698395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:38.700157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:38.714441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0c74-7cee-482b-86ef-8f4786adf4cc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:38.775220 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:38.776033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:38.776315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:38.776588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] PATH_INFO: `/v3/projects/4d53aaa2bb9141c0bf8ba4dad1b41464` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:38.777769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d53aaa2bb9141c0bf8ba4dad1b41464)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:38.779699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:38.823573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:38.826646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d53aaa2bb9141c0bf8ba4dad1b41464', 'request_id': 'req-704f9537-1565-4589-81ca-8e71dc336218'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.834960 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d53aaa2bb9141c0bf8ba4dad1b41464', 'request_id': 'req-704f9537-1565-4589-81ca-8e71dc336218'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.842030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d53aaa2bb9141c0bf8ba4dad1b41464', 'request_id': 'req-704f9537-1565-4589-81ca-8e71dc336218'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.853027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] The token cache is being invalidate because project 4d53aaa2bb9141c0bf8ba4dad1b41464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:38.853309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.853931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-704f9537-1565-4589-81ca-8e71dc336218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:38.855739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1025/2027] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:38 2022] DELETE /identity/v3/projects/4d53aaa2bb9141c0bf8ba4dad1b41464 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:38.861292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d77f-d966-438a-81ba-7fa46b47ca68 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:38.861574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d77f-d966-438a-81ba-7fa46b47ca68 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:38.861848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d77f-d966-438a-81ba-7fa46b47ca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:38.879286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-14a0d77f-d966-438a-81ba-7fa46b47ca68 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:38.880543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-14a0d77f-d966-438a-81ba-7fa46b47ca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:38.940343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1003/2028] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:38.948565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba0952-1328-4c50-9ba9-30bd36c9de44 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:38.948944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba0952-1328-4c50-9ba9-30bd36c9de44 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:38.949233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba0952-1328-4c50-9ba9-30bd36c9de44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:38.971158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-54ba0952-1328-4c50-9ba9-30bd36c9de44 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:38.972533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-54ba0952-1328-4c50-9ba9-30bd36c9de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:38.981562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1026/2029] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:38.986584 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d77f-d966-438a-81ba-7fa46b47ca68 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:38.997206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d77f-d966-438a-81ba-7fa46b47ca68 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.004298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954796e-c50b-45b9-a29f-913f06916607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.005307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954796e-c50b-45b9-a29f-913f06916607 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.005644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954796e-c50b-45b9-a29f-913f06916607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.006009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954796e-c50b-45b9-a29f-913f06916607 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.006749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954796e-c50b-45b9-a29f-913f06916607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:39.007066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954796e-c50b-45b9-a29f-913f06916607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.008709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954796e-c50b-45b9-a29f-913f06916607 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.021109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1004/2030] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:28:39.025579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba0952-1328-4c50-9ba9-30bd36c9de44 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.035414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba0952-1328-4c50-9ba9-30bd36c9de44 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.040382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d924f-ac2a-4ded-81f4-9b747399d97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.041092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d924f-ac2a-4ded-81f4-9b747399d97d admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.041380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d924f-ac2a-4ded-81f4-9b747399d97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.041662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d924f-ac2a-4ded-81f4-9b747399d97d admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.042374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d924f-ac2a-4ded-81f4-9b747399d97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.044341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d924f-ac2a-4ded-81f4-9b747399d97d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.071728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1027/2031] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:39 2022] POST /identity/v3/projects => generated 410 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:39.076158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954796e-c50b-45b9-a29f-913f06916607 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.087706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954796e-c50b-45b9-a29f-913f06916607 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.145277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acf4fd-11aa-4157-af56-a53fac74489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.145939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acf4fd-11aa-4157-af56-a53fac74489a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.146226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acf4fd-11aa-4157-af56-a53fac74489a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.146494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acf4fd-11aa-4157-af56-a53fac74489a admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.147168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acf4fd-11aa-4157-af56-a53fac74489a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.149105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acf4fd-11aa-4157-af56-a53fac74489a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.170632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1005/2032] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:39 2022] POST /identity/v3/users => generated 306 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:39.174556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d924f-ac2a-4ded-81f4-9b747399d97d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.186500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d924f-ac2a-4ded-81f4-9b747399d97d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.189916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acf4fd-11aa-4157-af56-a53fac74489a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.191581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40845c4-d6c5-4576-a897-0aa5e014c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.191714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-74acf4fd-11aa-4157-af56-a53fac74489a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:39.192399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40845c4-d6c5-4576-a897-0aa5e014c281 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.192903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40845c4-d6c5-4576-a897-0aa5e014c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.193140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40845c4-d6c5-4576-a897-0aa5e014c281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.193946 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40845c4-d6c5-4576-a897-0aa5e014c281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.195655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40845c4-d6c5-4576-a897-0aa5e014c281 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.208282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acf4fd-11aa-4157-af56-a53fac74489a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.213062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1028/2033] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:39 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:39.213478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.214322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40845c4-d6c5-4576-a897-0aa5e014c281 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.214425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.214709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.215024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] PATH_INFO: `/v3/users/59146db3bed743aab4224fa5bd576fdb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.216539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59146db3bed743aab4224fa5bd576fdb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.218718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.227524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40845c4-d6c5-4576-a897-0aa5e014c281 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.232628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd987d7-ba34-4dbb-b6d1-b6052194f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.233304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd987d7-ba34-4dbb-b6d1-b6052194f64c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.233582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd987d7-ba34-4dbb-b6d1-b6052194f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.233873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd987d7-ba34-4dbb-b6d1-b6052194f64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.234612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd987d7-ba34-4dbb-b6d1-b6052194f64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.236294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd987d7-ba34-4dbb-b6d1-b6052194f64c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.254477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1029/2034] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:39 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:39.255834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd987d7-ba34-4dbb-b6d1-b6052194f64c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.269849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd987d7-ba34-4dbb-b6d1-b6052194f64c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.284734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecc342-d910-4cb8-a670-d6a1c22cbc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.284734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecc342-d910-4cb8-a670-d6a1c22cbc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.284734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecc342-d910-4cb8-a670-d6a1c22cbc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.284734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecc342-d910-4cb8-a670-d6a1c22cbc34 admin admin] PATH_INFO: `/v3/projects/b02d568e44ff400db8c62dae38893200/users/707a792342b447b39564ed8324046076/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.295769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecc342-d910-4cb8-a670-d6a1c22cbc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02d568e44ff400db8c62dae38893200, user_id=707a792342b447b39564ed8324046076, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.298866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecc342-d910-4cb8-a670-d6a1c22cbc34 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.303834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59146db3bed743aab4224fa5bd576fdb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:39.304694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59146db3bed743aab4224fa5bd576fdb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:39.323391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1030/2035] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:39 2022] PUT /identity/v3/projects/b02d568e44ff400db8c62dae38893200/users/707a792342b447b39564ed8324046076/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:39.328212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb62190-968f-4634-97ea-a2f17230d9ff None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.328710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb62190-968f-4634-97ea-a2f17230d9ff None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.329724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb62190-968f-4634-97ea-a2f17230d9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.332332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59146db3bed743aab4224fa5bd576fdb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:39.335420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:39.343131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59146db3bed743aab4224fa5bd576fdb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:39.346039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-60d0d6bb-97fa-4ec4-8006-75422a194371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59146db3bed743aab4224fa5bd576fdb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:39.364665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1006/2036] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:39 2022] DELETE /identity/v3/users/59146db3bed743aab4224fa5bd576fdb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:39.370352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f0f08-f5cd-4213-8b50-997b13785d4e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.370352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f0f08-f5cd-4213-8b50-997b13785d4e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.373954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f0f08-f5cd-4213-8b50-997b13785d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.378023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fbb62190-968f-4634-97ea-a2f17230d9ff None None] MFA Rules not processed for user `707a792342b447b39564ed8324046076`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:39.379998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fbb62190-968f-4634-97ea-a2f17230d9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:39.392837 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b41f0f08-f5cd-4213-8b50-997b13785d4e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:39.394219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b41f0f08-f5cd-4213-8b50-997b13785d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:39.467757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1031/2037] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:39.475447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb62190-968f-4634-97ea-a2f17230d9ff None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.476901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fbb62190-968f-4634-97ea-a2f17230d9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:39.509449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1007/2038] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:39.523220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f0f08-f5cd-4213-8b50-997b13785d4e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.525094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b41f0f08-f5cd-4213-8b50-997b13785d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:39.544382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:39.572105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb62190-968f-4634-97ea-a2f17230d9ff None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.577025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0dda0-7e58-4b7b-95ba-5184962a109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.577692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0dda0-7e58-4b7b-95ba-5184962a109f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.577978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0dda0-7e58-4b7b-95ba-5184962a109f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.578256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0dda0-7e58-4b7b-95ba-5184962a109f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.579006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0dda0-7e58-4b7b-95ba-5184962a109f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.581747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0dda0-7e58-4b7b-95ba-5184962a109f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.603217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f0f08-f5cd-4213-8b50-997b13785d4e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.609143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dabb6-884c-4fcb-bd48-79fa726aa4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.609898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dabb6-884c-4fcb-bd48-79fa726aa4fb service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.610213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dabb6-884c-4fcb-bd48-79fa726aa4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.610492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dabb6-884c-4fcb-bd48-79fa726aa4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.616445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1032/2039] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:39 2022] POST /identity/v3/projects => generated 410 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:39.617289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0dda0-7e58-4b7b-95ba-5184962a109f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.636792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dabb6-884c-4fcb-bd48-79fa726aa4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.638305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dabb6-884c-4fcb-bd48-79fa726aa4fb service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.650860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1008/2040] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:39.770492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0dda0-7e58-4b7b-95ba-5184962a109f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.784295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86578bc4-0204-4963-87bf-63c4057c0e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.785290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86578bc4-0204-4963-87bf-63c4057c0e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.785735 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86578bc4-0204-4963-87bf-63c4057c0e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.786902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86578bc4-0204-4963-87bf-63c4057c0e7c admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.789014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86578bc4-0204-4963-87bf-63c4057c0e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.794769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86578bc4-0204-4963-87bf-63c4057c0e7c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.841995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1033/2041] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:39 2022] POST /identity/v3/users => generated 312 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:39.846779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dabb6-884c-4fcb-bd48-79fa726aa4fb service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.858649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dabb6-884c-4fcb-bd48-79fa726aa4fb service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.867095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca58432-e241-4090-b748-be42ada5a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.867095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca58432-e241-4090-b748-be42ada5a598 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.867095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca58432-e241-4090-b748-be42ada5a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.867095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca58432-e241-4090-b748-be42ada5a598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.867576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca58432-e241-4090-b748-be42ada5a598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.868989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca58432-e241-4090-b748-be42ada5a598 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:39.884262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1009/2042] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:39 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:39.888384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86578bc4-0204-4963-87bf-63c4057c0e7c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:39.909660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86578bc4-0204-4963-87bf-63c4057c0e7c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:39.923481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab4caf-5789-4d73-bf77-bc03b8c025d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:39.924569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab4caf-5789-4d73-bf77-bc03b8c025d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:39.924907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab4caf-5789-4d73-bf77-bc03b8c025d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:39.925183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab4caf-5789-4d73-bf77-bc03b8c025d0 admin admin] PATH_INFO: `/v3/projects/9947a1041e734b2f9949e5b47edd59ce/users/38328f1695b44e4cacfe4525c98a870f/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:39.969458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab4caf-5789-4d73-bf77-bc03b8c025d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9947a1041e734b2f9949e5b47edd59ce, user_id=38328f1695b44e4cacfe4525c98a870f, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:39.973862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab4caf-5789-4d73-bf77-bc03b8c025d0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:40.022855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1034/2043] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:39 2022] PUT /identity/v3/projects/9947a1041e734b2f9949e5b47edd59ce/users/38328f1695b44e4cacfe4525c98a870f/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:40.029160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca58432-e241-4090-b748-be42ada5a598 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:40.045932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca58432-e241-4090-b748-be42ada5a598 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:40.145299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d26765-5a74-4f40-932e-355e34fed561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:40.146145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d26765-5a74-4f40-932e-355e34fed561 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:40.147074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d26765-5a74-4f40-932e-355e34fed561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:40.147380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d26765-5a74-4f40-932e-355e34fed561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:40.148160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d26765-5a74-4f40-932e-355e34fed561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:40.150358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d26765-5a74-4f40-932e-355e34fed561 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:40.176177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1010/2044] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:40 2022] GET /identity/v3/roles => generated 1427 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:40.182644 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab4caf-5789-4d73-bf77-bc03b8c025d0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:40.194965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d26765-5a74-4f40-932e-355e34fed561 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:40.196888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-48d26765-5a74-4f40-932e-355e34fed561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:40.198005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab4caf-5789-4d73-bf77-bc03b8c025d0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:40.203413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd9ba2-29bd-494e-ab64-3cdbc113a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:40.204558 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd9ba2-29bd-494e-ab64-3cdbc113a3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:40.204967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd9ba2-29bd-494e-ab64-3cdbc113a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:40.205423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd9ba2-29bd-494e-ab64-3cdbc113a3a4 admin admin] PATH_INFO: `/v3/projects/9947a1041e734b2f9949e5b47edd59ce/users/38328f1695b44e4cacfe4525c98a870f/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:40.207717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd9ba2-29bd-494e-ab64-3cdbc113a3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9947a1041e734b2f9949e5b47edd59ce, user_id=38328f1695b44e4cacfe4525c98a870f, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:40.210565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd9ba2-29bd-494e-ab64-3cdbc113a3a4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:40.219352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d26765-5a74-4f40-932e-355e34fed561 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:40.236694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1035/2045] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:40 2022] PUT /identity/v3/projects/9947a1041e734b2f9949e5b47edd59ce/users/38328f1695b44e4cacfe4525c98a870f/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:40.241606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:40.250277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8692a-d094-4e98-9155-35339fc9c01c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:40.250682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8692a-d094-4e98-9155-35339fc9c01c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:40.250825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8692a-d094-4e98-9155-35339fc9c01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:40.280016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b8e8692a-d094-4e98-9155-35339fc9c01c None None] MFA Rules not processed for user `38328f1695b44e4cacfe4525c98a870f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:40.281225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b8e8692a-d094-4e98-9155-35339fc9c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:40.316870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:40.317815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:40.318090 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:40.318366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] PATH_INFO: `/v3/projects/2fb0a2a792cd48b09c8a092529f234b9` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:40.319857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb0a2a792cd48b09c8a092529f234b9)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:40.321943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:40.402443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb0a2a792cd48b09c8a092529f234b9', 'request_id': 'req-d41c4eee-7d58-47dd-908a-e3829e61c62d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:40.405948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1036/2046] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:40 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:40.411494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb0a2a792cd48b09c8a092529f234b9', 'request_id': 'req-d41c4eee-7d58-47dd-908a-e3829e61c62d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:40.418691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8692a-d094-4e98-9155-35339fc9c01c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:40.420947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb0a2a792cd48b09c8a092529f234b9', 'request_id': 'req-d41c4eee-7d58-47dd-908a-e3829e61c62d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:40.423837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b8e8692a-d094-4e98-9155-35339fc9c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:40.437761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] The token cache is being invalidate because project 2fb0a2a792cd48b09c8a092529f234b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:40.438059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:40.439996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:40.441445 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:40.442088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1011/2047] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:40 2022] DELETE /identity/v3/projects/2fb0a2a792cd48b09c8a092529f234b9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:40.520481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8692a-d094-4e98-9155-35339fc9c01c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:40.621918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:40.622599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:40.622892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:40.623170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:40.630257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:40.719579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:40.721323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:40.732417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1037/2048] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:40 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:40.919337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:40.920843 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:40.933712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c4eee-7d58-47dd-908a-e3829e61c62d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:40.937358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98942-79c5-47ac-978a-7a5b0f56a625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:40.938007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98942-79c5-47ac-978a-7a5b0f56a625 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:40.938366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98942-79c5-47ac-978a-7a5b0f56a625 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:40.939153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98942-79c5-47ac-978a-7a5b0f56a625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:40.940973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-64c98942-79c5-47ac-978a-7a5b0f56a625 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:41.005713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c98942-79c5-47ac-978a-7a5b0f56a625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:41.007166 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c98942-79c5-47ac-978a-7a5b0f56a625 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:41.017126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1012/2049] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:40 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:41.825134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:41.826591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:41.895287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28061997-9cdf-4220-9bb8-9dc2a779712e service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:41.899947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:41.900844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:41.901129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:41.901405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] PATH_INFO: `/v3/users/60ccf030876e4d57b116e73139b4e857` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:41.902618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ccf030876e4d57b116e73139b4e857)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:41.904576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:41.926836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:41.953843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ccf030876e4d57b116e73139b4e857'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:41.954507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ccf030876e4d57b116e73139b4e857'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:41.961513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ccf030876e4d57b116e73139b4e857'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:41.962181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ccf030876e4d57b116e73139b4e857'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:41.971130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ccf030876e4d57b116e73139b4e857'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:41.989645 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1038/2050] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:41 2022] DELETE /identity/v3/users/60ccf030876e4d57b116e73139b4e857 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:41.994268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca37d81-0d1b-40e3-9fdd-cd8f262c9f72 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:41.994749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca37d81-0d1b-40e3-9fdd-cd8f262c9f72 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:41.994844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca37d81-0d1b-40e3-9fdd-cd8f262c9f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:42.012578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6ca37d81-0d1b-40e3-9fdd-cd8f262c9f72 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:42.013823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6ca37d81-0d1b-40e3-9fdd-cd8f262c9f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:42.056045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:42.079862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1013/2051] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:42.090290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:42.091885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:42.162649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc970a4-a48e-442a-adce-089ff0dfff0f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:42.166732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ba01-df1b-434f-a642-00c928b14979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:42.167432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ba01-df1b-434f-a642-00c928b14979 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:42.167759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ba01-df1b-434f-a642-00c928b14979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:42.168039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009ba01-df1b-434f-a642-00c928b14979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:42.178410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009ba01-df1b-434f-a642-00c928b14979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:42.179862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009ba01-df1b-434f-a642-00c928b14979 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:42.189845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1039/2052] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:42.557052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca37d81-0d1b-40e3-9fdd-cd8f262c9f72 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:42.559106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6ca37d81-0d1b-40e3-9fdd-cd8f262c9f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:42.580088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca37d81-0d1b-40e3-9fdd-cd8f262c9f72 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:42.585792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:42.586881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:42.587171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:42.588055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] PATH_INFO: `/v3/projects/6ec74746ec8c4a94883569d1a2348442` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:42.589318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec74746ec8c4a94883569d1a2348442)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:42.591254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:42.644256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec74746ec8c4a94883569d1a2348442', 'request_id': 'req-f114db22-d831-43c8-b885-773a265f56b3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.652075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec74746ec8c4a94883569d1a2348442', 'request_id': 'req-f114db22-d831-43c8-b885-773a265f56b3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.664116 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec74746ec8c4a94883569d1a2348442', 'request_id': 'req-f114db22-d831-43c8-b885-773a265f56b3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.677712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] The token cache is being invalidate because project 6ec74746ec8c4a94883569d1a2348442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:42.677712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.678411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.680097 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1014/2053] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:42 2022] DELETE /identity/v3/projects/6ec74746ec8c4a94883569d1a2348442 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:42.684534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ba01-df1b-434f-a642-00c928b14979 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:42.694374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009ba01-df1b-434f-a642-00c928b14979 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:42.754850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:42.755953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:42.756068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:42.756346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] PATH_INFO: `/v3/users/eb6d64b30f504b95b27ad1d0a81be477` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:42.757581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6d64b30f504b95b27ad1d0a81be477)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:42.759578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:42.806739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:42.812986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6d64b30f504b95b27ad1d0a81be477'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.814550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6d64b30f504b95b27ad1d0a81be477'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.822423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6d64b30f504b95b27ad1d0a81be477'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.823099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6d64b30f504b95b27ad1d0a81be477'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.832561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1ace738c-a5ba-40d2-acec-a4758e85f436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6d64b30f504b95b27ad1d0a81be477'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:42.851675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1040/2054] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:42 2022] DELETE /identity/v3/users/eb6d64b30f504b95b27ad1d0a81be477 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:43.148441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:43.149910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:43.186922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114db22-d831-43c8-b885-773a265f56b3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:43.264632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:43.265518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.265805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.266109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] PATH_INFO: `/v3/projects/8e15cdbc8aa9485aa6f1b27e340a35a6` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.267420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e15cdbc8aa9485aa6f1b27e340a35a6)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:43.269896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:43.332782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e15cdbc8aa9485aa6f1b27e340a35a6', 'request_id': 'req-ae1eac7f-8c9a-4d43-af39-479c790644d7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:43.340080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e15cdbc8aa9485aa6f1b27e340a35a6', 'request_id': 'req-ae1eac7f-8c9a-4d43-af39-479c790644d7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:43.349339 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e15cdbc8aa9485aa6f1b27e340a35a6', 'request_id': 'req-ae1eac7f-8c9a-4d43-af39-479c790644d7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:43.354962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:43.363496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] The token cache is being invalidate because project 8e15cdbc8aa9485aa6f1b27e340a35a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:43.363900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:43.364961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ae1eac7f-8c9a-4d43-af39-479c790644d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:43.366820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1015/2055] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:43 2022] DELETE /identity/v3/projects/8e15cdbc8aa9485aa6f1b27e340a35a6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:43.372032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77d46-eaf0-4164-855f-8887d49cea63 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.372688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77d46-eaf0-4164-855f-8887d49cea63 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.373077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77d46-eaf0-4164-855f-8887d49cea63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.396868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8df77d46-eaf0-4164-855f-8887d49cea63 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:43.398183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8df77d46-eaf0-4164-855f-8887d49cea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:43.466032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1041/2056] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:43.476378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f47b7-5909-411e-ad1c-84b1e1787b4d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.476699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f47b7-5909-411e-ad1c-84b1e1787b4d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.477281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f47b7-5909-411e-ad1c-84b1e1787b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.502697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d42f47b7-5909-411e-ad1c-84b1e1787b4d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:43.504214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d42f47b7-5909-411e-ad1c-84b1e1787b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:43.521789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1016/2057] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:43.527660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77d46-eaf0-4164-855f-8887d49cea63 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:43.543787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77d46-eaf0-4164-855f-8887d49cea63 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:43.549157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be715eb-374c-45e0-ac22-a3b08fa8897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:43.549921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be715eb-374c-45e0-ac22-a3b08fa8897c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.550431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be715eb-374c-45e0-ac22-a3b08fa8897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.550908 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be715eb-374c-45e0-ac22-a3b08fa8897c admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.551815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be715eb-374c-45e0-ac22-a3b08fa8897c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:43.555803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be715eb-374c-45e0-ac22-a3b08fa8897c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:43.555803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be715eb-374c-45e0-ac22-a3b08fa8897c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:43.567322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1042/2058] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:43.571706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f47b7-5909-411e-ad1c-84b1e1787b4d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:43.581625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f47b7-5909-411e-ad1c-84b1e1787b4d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:43.587132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28894803-308d-4bea-a581-89199281e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:43.587923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894803-308d-4bea-a581-89199281e9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.588278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894803-308d-4bea-a581-89199281e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.588619 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28894803-308d-4bea-a581-89199281e9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.589376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28894803-308d-4bea-a581-89199281e9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:43.591323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28894803-308d-4bea-a581-89199281e9fd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:43.621811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1017/2059] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:43 2022] POST /identity/v3/projects => generated 386 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:43.623018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be715eb-374c-45e0-ac22-a3b08fa8897c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:43.633350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be715eb-374c-45e0-ac22-a3b08fa8897c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:43.692498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d0bd9-11a2-41d5-bf24-db7ddb1042b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:43.693186 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0bd9-11a2-41d5-bf24-db7ddb1042b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.693451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0bd9-11a2-41d5-bf24-db7ddb1042b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.693724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0bd9-11a2-41d5-bf24-db7ddb1042b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.694522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d0bd9-11a2-41d5-bf24-db7ddb1042b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:43.696724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d0bd9-11a2-41d5-bf24-db7ddb1042b5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:43.721038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1043/2060] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:43 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:43.725139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28894803-308d-4bea-a581-89199281e9fd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:43.735642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28894803-308d-4bea-a581-89199281e9fd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:43.741062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffa018-71dc-4230-9ada-048262d48231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:43.741830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffa018-71dc-4230-9ada-048262d48231 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.742182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffa018-71dc-4230-9ada-048262d48231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.742464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffa018-71dc-4230-9ada-048262d48231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.743212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffa018-71dc-4230-9ada-048262d48231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:43.744865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffa018-71dc-4230-9ada-048262d48231 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:43.759903 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1018/2061] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:43 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:43.761458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d0bd9-11a2-41d5-bf24-db7ddb1042b5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:43.772849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d0bd9-11a2-41d5-bf24-db7ddb1042b5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:43.777649 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1d9a6-74c3-466e-a7d6-cd9dea922ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:43.778318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1d9a6-74c3-466e-a7d6-cd9dea922ced admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.778784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1d9a6-74c3-466e-a7d6-cd9dea922ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.779107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1d9a6-74c3-466e-a7d6-cd9dea922ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.779868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1d9a6-74c3-466e-a7d6-cd9dea922ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:43.781480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1d9a6-74c3-466e-a7d6-cd9dea922ced admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:43.793583 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1044/2062] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:43 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:43.799025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffa018-71dc-4230-9ada-048262d48231 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:43.809842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffa018-71dc-4230-9ada-048262d48231 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:43.815348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4321b-b182-4b61-95e7-46eecc80c985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:43.816260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4321b-b182-4b61-95e7-46eecc80c985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.816549 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4321b-b182-4b61-95e7-46eecc80c985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.816828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4321b-b182-4b61-95e7-46eecc80c985 admin admin] PATH_INFO: `/v3/projects/3b03110ecb66433895fe9135cab130b4/users/8163f12a685a495ea5c3783db45c3aed/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.833138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4321b-b182-4b61-95e7-46eecc80c985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b03110ecb66433895fe9135cab130b4, user_id=8163f12a685a495ea5c3783db45c3aed, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:43.835845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4321b-b182-4b61-95e7-46eecc80c985 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:43.850597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1019/2063] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:43 2022] PUT /identity/v3/projects/3b03110ecb66433895fe9135cab130b4/users/8163f12a685a495ea5c3783db45c3aed/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:43.861482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5e213-e4eb-43d3-b7ad-8553919219c2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:43.862036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5e213-e4eb-43d3-b7ad-8553919219c2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:43.862297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5e213-e4eb-43d3-b7ad-8553919219c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:43.893928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-79d5e213-e4eb-43d3-b7ad-8553919219c2 None None] MFA Rules not processed for user `8163f12a685a495ea5c3783db45c3aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:43.895269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-79d5e213-e4eb-43d3-b7ad-8553919219c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:43.909938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:43.973810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1045/2064] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:43.978397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4321b-b182-4b61-95e7-46eecc80c985 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:44.050757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4321b-b182-4b61-95e7-46eecc80c985 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:44.055546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f20688-7eec-4caf-9d00-16994884d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:44.056259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f20688-7eec-4caf-9d00-16994884d778 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:44.056680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f20688-7eec-4caf-9d00-16994884d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:44.056961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f20688-7eec-4caf-9d00-16994884d778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:44.057664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f20688-7eec-4caf-9d00-16994884d778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:44.059603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f20688-7eec-4caf-9d00-16994884d778 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:44.097832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1020/2065] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:43 2022] POST /identity/v3/projects => generated 386 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:44.099221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5e213-e4eb-43d3-b7ad-8553919219c2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:44.111964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5e213-e4eb-43d3-b7ad-8553919219c2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:44.188115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6c731-26dc-4f1c-8011-b9b44197ea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:44.188872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6c731-26dc-4f1c-8011-b9b44197ea42 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:44.189151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6c731-26dc-4f1c-8011-b9b44197ea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:44.189472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6c731-26dc-4f1c-8011-b9b44197ea42 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:44.190170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6c731-26dc-4f1c-8011-b9b44197ea42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:44.192102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6c731-26dc-4f1c-8011-b9b44197ea42 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:44.221292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1046/2066] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:44 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:44.225713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f20688-7eec-4caf-9d00-16994884d778 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:44.238119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f20688-7eec-4caf-9d00-16994884d778 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:44.243162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466b612-13e3-4737-8d8b-d81da2dcddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:44.244014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466b612-13e3-4737-8d8b-d81da2dcddbd admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:44.244368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466b612-13e3-4737-8d8b-d81da2dcddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:44.244738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466b612-13e3-4737-8d8b-d81da2dcddbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:44.245565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466b612-13e3-4737-8d8b-d81da2dcddbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:44.247308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466b612-13e3-4737-8d8b-d81da2dcddbd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:44.260952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1021/2067] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:44 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:44.265402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6c731-26dc-4f1c-8011-b9b44197ea42 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:44.279269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6c731-26dc-4f1c-8011-b9b44197ea42 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:44.285069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458937f9-de1c-489e-9af9-c9b9b3b779e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:44.285952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458937f9-de1c-489e-9af9-c9b9b3b779e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:44.286238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458937f9-de1c-489e-9af9-c9b9b3b779e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:44.286519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458937f9-de1c-489e-9af9-c9b9b3b779e5 admin admin] PATH_INFO: `/v3/projects/8c862b3264b540f9a43ad7dd9458deeb/users/b601ce63da99406f9ea7be48ec6a3b2e/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:44.303737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458937f9-de1c-489e-9af9-c9b9b3b779e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c862b3264b540f9a43ad7dd9458deeb, user_id=b601ce63da99406f9ea7be48ec6a3b2e, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:44.306799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458937f9-de1c-489e-9af9-c9b9b3b779e5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:44.321338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1047/2068] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:44 2022] PUT /identity/v3/projects/8c862b3264b540f9a43ad7dd9458deeb/users/b601ce63da99406f9ea7be48ec6a3b2e/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:44.325627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466b612-13e3-4737-8d8b-d81da2dcddbd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:44.337677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466b612-13e3-4737-8d8b-d81da2dcddbd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:44.405314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a39bbb-ff5d-48e5-b8bc-c0dea1edb48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:44.406268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39bbb-ff5d-48e5-b8bc-c0dea1edb48c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:44.407588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39bbb-ff5d-48e5-b8bc-c0dea1edb48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:44.407588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a39bbb-ff5d-48e5-b8bc-c0dea1edb48c admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:44.408983 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a39bbb-ff5d-48e5-b8bc-c0dea1edb48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:44.411284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a39bbb-ff5d-48e5-b8bc-c0dea1edb48c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:44.423775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1022/2069] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:44 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:44.431119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458937f9-de1c-489e-9af9-c9b9b3b779e5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:44.444984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458937f9-de1c-489e-9af9-c9b9b3b779e5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:44.450922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f977724-6429-4b57-877d-7740a79cbcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:44.451895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f977724-6429-4b57-877d-7740a79cbcd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:44.452186 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f977724-6429-4b57-877d-7740a79cbcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:44.452462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f977724-6429-4b57-877d-7740a79cbcd4 admin admin] PATH_INFO: `/v3/projects/8c862b3264b540f9a43ad7dd9458deeb/users/b601ce63da99406f9ea7be48ec6a3b2e/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:44.455061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f977724-6429-4b57-877d-7740a79cbcd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c862b3264b540f9a43ad7dd9458deeb, user_id=b601ce63da99406f9ea7be48ec6a3b2e, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:44.457758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f977724-6429-4b57-877d-7740a79cbcd4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:44.473700 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1048/2070] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:44 2022] PUT /identity/v3/projects/8c862b3264b540f9a43ad7dd9458deeb/users/b601ce63da99406f9ea7be48ec6a3b2e/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:44.486219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647e687-f654-49ae-9b30-0fb6a337c50c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:44.486514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647e687-f654-49ae-9b30-0fb6a337c50c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:44.486797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647e687-f654-49ae-9b30-0fb6a337c50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:44.492691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:44.519248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4647e687-f654-49ae-9b30-0fb6a337c50c None None] MFA Rules not processed for user `b601ce63da99406f9ea7be48ec6a3b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:44.520539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4647e687-f654-49ae-9b30-0fb6a337c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:44.592065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1023/2071] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:44.603578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f977724-6429-4b57-877d-7740a79cbcd4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:44.605586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3f977724-6429-4b57-877d-7740a79cbcd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:44.670941 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f977724-6429-4b57-877d-7740a79cbcd4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:44.675053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd8768-82cc-4652-b47d-a05345af7a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:44.675755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8768-82cc-4652-b47d-a05345af7a69 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:44.676122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8768-82cc-4652-b47d-a05345af7a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:44.676306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8768-82cc-4652-b47d-a05345af7a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:44.696514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:44.740720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd8768-82cc-4652-b47d-a05345af7a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:44.742167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd8768-82cc-4652-b47d-a05345af7a69 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:44.751750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1049/2072] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:45.516929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647e687-f654-49ae-9b30-0fb6a337c50c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:45.518391 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4647e687-f654-49ae-9b30-0fb6a337c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:45.598655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647e687-f654-49ae-9b30-0fb6a337c50c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:45.604159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:45.605546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:45.605840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:45.606120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] PATH_INFO: `/v3/users/179b2dea45364fb99731a2ee40c42d95` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:45.607973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] RBAC: Authorizing `identity:delete_user(user_id=179b2dea45364fb99731a2ee40c42d95)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:45.610882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:45.660547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179b2dea45364fb99731a2ee40c42d95'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:45.661240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179b2dea45364fb99731a2ee40c42d95'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:45.673682 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179b2dea45364fb99731a2ee40c42d95'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:45.680477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179b2dea45364fb99731a2ee40c42d95'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:45.681145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179b2dea45364fb99731a2ee40c42d95'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:45.693966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1024/2073] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:45 2022] DELETE /identity/v3/users/179b2dea45364fb99731a2ee40c42d95 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:45.698466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ff77-223d-4a03-ad6a-03884197022b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:45.698972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ff77-223d-4a03-ad6a-03884197022b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:45.699066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288ff77-223d-4a03-ad6a-03884197022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:45.717934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a288ff77-223d-4a03-ad6a-03884197022b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:45.720004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a288ff77-223d-4a03-ad6a-03884197022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:45.787844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1050/2074] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:45.798069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:45.799679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:45.810203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:45.869770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa84f35-38f3-4b48-82e2-ff92739df56c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:45.873839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f824b9-e337-40d3-822c-198d3d7eb9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:45.874495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f824b9-e337-40d3-822c-198d3d7eb9fa service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:45.874779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f824b9-e337-40d3-822c-198d3d7eb9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:45.875059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f824b9-e337-40d3-822c-198d3d7eb9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:45.885293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f824b9-e337-40d3-822c-198d3d7eb9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:45.886836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f824b9-e337-40d3-822c-198d3d7eb9fa service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:45.897167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1025/2075] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:46.178688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ff77-223d-4a03-ad6a-03884197022b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:46.181783 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a288ff77-223d-4a03-ad6a-03884197022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:46.205192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288ff77-223d-4a03-ad6a-03884197022b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:46.205192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:46.205970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.206317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.206618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] PATH_INFO: `/v3/projects/9e8f7fb3b31f4f2ba545182786d6d837` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.208437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8f7fb3b31f4f2ba545182786d6d837)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:46.210805 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:46.270873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8f7fb3b31f4f2ba545182786d6d837', 'request_id': 'req-83d302b1-e371-4b9e-89bc-13b4e08088bd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.277426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8f7fb3b31f4f2ba545182786d6d837', 'request_id': 'req-83d302b1-e371-4b9e-89bc-13b4e08088bd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.287086 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8f7fb3b31f4f2ba545182786d6d837', 'request_id': 'req-83d302b1-e371-4b9e-89bc-13b4e08088bd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.309731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] The token cache is being invalidate because project 9e8f7fb3b31f4f2ba545182786d6d837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:46.310114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.311332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d302b1-e371-4b9e-89bc-13b4e08088bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.317810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1051/2076] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:46 2022] DELETE /identity/v3/projects/9e8f7fb3b31f4f2ba545182786d6d837 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:46.320996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4111-a93e-4106-b2c1-98dbd365944b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.321444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4111-a93e-4106-b2c1-98dbd365944b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.321729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4111-a93e-4106-b2c1-98dbd365944b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.346020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-263e4111-a93e-4106-b2c1-98dbd365944b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:46.347280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-263e4111-a93e-4106-b2c1-98dbd365944b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:46.461538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1026/2077] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:46.467422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1023c18-ccf9-4891-a96d-bb5ceca7be63 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.468004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1023c18-ccf9-4891-a96d-bb5ceca7be63 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.468458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1023c18-ccf9-4891-a96d-bb5ceca7be63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.499205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c1023c18-ccf9-4891-a96d-bb5ceca7be63 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:46.500976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c1023c18-ccf9-4891-a96d-bb5ceca7be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:46.513692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1052/2078] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:46.519629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e4111-a93e-4106-b2c1-98dbd365944b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:46.538025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e4111-a93e-4106-b2c1-98dbd365944b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:46.553544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbc3bd-85f9-4d6b-8eca-62a0ecb9b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:46.554478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbc3bd-85f9-4d6b-8eca-62a0ecb9b852 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.555115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbc3bd-85f9-4d6b-8eca-62a0ecb9b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.555988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbc3bd-85f9-4d6b-8eca-62a0ecb9b852 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.556977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbc3bd-85f9-4d6b-8eca-62a0ecb9b852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:46.557510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbc3bd-85f9-4d6b-8eca-62a0ecb9b852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:46.559649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbc3bd-85f9-4d6b-8eca-62a0ecb9b852 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:46.584835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1023c18-ccf9-4891-a96d-bb5ceca7be63 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:46.586352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c1023c18-ccf9-4891-a96d-bb5ceca7be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:46.589938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1027/2079] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:46.591171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbc3bd-85f9-4d6b-8eca-62a0ecb9b852 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:46.601162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1023c18-ccf9-4891-a96d-bb5ceca7be63 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:46.602430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbc3bd-85f9-4d6b-8eca-62a0ecb9b852 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:46.606576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:46.607579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.607887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.608147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ebad9-5fce-4b93-8f8a-8c731be371e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:46.608273 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] PATH_INFO: `/v3/users/707a792342b447b39564ed8324046076` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.608814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ebad9-5fce-4b93-8f8a-8c731be371e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.609092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ebad9-5fce-4b93-8f8a-8c731be371e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.609362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ebad9-5fce-4b93-8f8a-8c731be371e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.610104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ebad9-5fce-4b93-8f8a-8c731be371e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:46.610259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=707a792342b447b39564ed8324046076)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:46.612059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ebad9-5fce-4b93-8f8a-8c731be371e7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:46.612439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:46.646871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1028/2080] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:46 2022] POST /identity/v3/projects => generated 406 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:46.653041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ebad9-5fce-4b93-8f8a-8c731be371e7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:46.662042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:46.685584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707a792342b447b39564ed8324046076'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.686297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707a792342b447b39564ed8324046076'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.699936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707a792342b447b39564ed8324046076'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.700921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707a792342b447b39564ed8324046076'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.712009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c5b4427-8a64-4507-bd39-536f07711dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707a792342b447b39564ed8324046076'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:46.737359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1053/2081] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:46 2022] DELETE /identity/v3/users/707a792342b447b39564ed8324046076 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:46.741502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed34f7-dc72-4dab-96e5-5c6629913aec None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.741824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed34f7-dc72-4dab-96e5-5c6629913aec None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.742131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed34f7-dc72-4dab-96e5-5c6629913aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.745126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ebad9-5fce-4b93-8f8a-8c731be371e7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:46.760806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f4ed34f7-dc72-4dab-96e5-5c6629913aec None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:46.761939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f4ed34f7-dc72-4dab-96e5-5c6629913aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:46.772712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:46.821770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23539-f4fa-4093-a541-25ab6c6c2e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:46.822727 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23539-f4fa-4093-a541-25ab6c6c2e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.823011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23539-f4fa-4093-a541-25ab6c6c2e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.823610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23539-f4fa-4093-a541-25ab6c6c2e58 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.824646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23539-f4fa-4093-a541-25ab6c6c2e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:46.826898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23539-f4fa-4093-a541-25ab6c6c2e58 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:46.836497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1054/2082] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:46.843799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed34f7-dc72-4dab-96e5-5c6629913aec None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:46.846165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f4ed34f7-dc72-4dab-96e5-5c6629913aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:46.865257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1029/2083] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:46 2022] POST /identity/v3/users => generated 304 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:46.866674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23539-f4fa-4093-a541-25ab6c6c2e58 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:46.868377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ddf23539-f4fa-4093-a541-25ab6c6c2e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:46.881493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23539-f4fa-4093-a541-25ab6c6c2e58 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:46.888306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ae284-1e75-4311-91c5-d285e896fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:46.888993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ae284-1e75-4311-91c5-d285e896fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.889432 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ae284-1e75-4311-91c5-d285e896fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.889718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ae284-1e75-4311-91c5-d285e896fcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.890536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ae284-1e75-4311-91c5-d285e896fcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:46.893400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ae284-1e75-4311-91c5-d285e896fcf3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:46.906099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1030/2084] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:46 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:46.911289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ae284-1e75-4311-91c5-d285e896fcf3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:46.930002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ae284-1e75-4311-91c5-d285e896fcf3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:46.941372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d672b-98ed-411e-a8a6-67e6ef3623b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:46.942158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d672b-98ed-411e-a8a6-67e6ef3623b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.942517 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d672b-98ed-411e-a8a6-67e6ef3623b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.942866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d672b-98ed-411e-a8a6-67e6ef3623b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.943771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d672b-98ed-411e-a8a6-67e6ef3623b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:46.946272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d672b-98ed-411e-a8a6-67e6ef3623b2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:46.960057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1031/2085] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:46 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:46.962331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed34f7-dc72-4dab-96e5-5c6629913aec None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:46.964548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d672b-98ed-411e-a8a6-67e6ef3623b2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:46.966910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118758ad-f157-4b5f-bfe7-0d015108aa87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:46.968227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118758ad-f157-4b5f-bfe7-0d015108aa87 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.968521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118758ad-f157-4b5f-bfe7-0d015108aa87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.968807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118758ad-f157-4b5f-bfe7-0d015108aa87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.976242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d672b-98ed-411e-a8a6-67e6ef3623b2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:46.987450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ec30d-5b5f-49b3-8d32-fa0a1e25cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:46.989053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ec30d-5b5f-49b3-8d32-fa0a1e25cdc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:46.989053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ec30d-5b5f-49b3-8d32-fa0a1e25cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:46.989053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ec30d-5b5f-49b3-8d32-fa0a1e25cdc8 admin admin] PATH_INFO: `/v3/projects/7fceba775b9848c5be11ad6f8911a205/users/f7b1baccf36d446b847441b2746d5588/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:46.990215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118758ad-f157-4b5f-bfe7-0d015108aa87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:46.992434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118758ad-f157-4b5f-bfe7-0d015108aa87 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.019673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1055/2086] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:47.023037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ec30d-5b5f-49b3-8d32-fa0a1e25cdc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fceba775b9848c5be11ad6f8911a205, user_id=f7b1baccf36d446b847441b2746d5588, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:47.026005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ec30d-5b5f-49b3-8d32-fa0a1e25cdc8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.045182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1032/2087] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:46 2022] PUT /identity/v3/projects/7fceba775b9848c5be11ad6f8911a205/users/f7b1baccf36d446b847441b2746d5588/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:47.056981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013348c-bbf4-4953-8fa9-90a474cda0cb None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.057321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013348c-bbf4-4953-8fa9-90a474cda0cb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.058699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013348c-bbf4-4953-8fa9-90a474cda0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.098919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f013348c-bbf4-4953-8fa9-90a474cda0cb None None] MFA Rules not processed for user `f7b1baccf36d446b847441b2746d5588`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:47.100248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f013348c-bbf4-4953-8fa9-90a474cda0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:47.190540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:47.244060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1056/2088] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:47.248597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ec30d-5b5f-49b3-8d32-fa0a1e25cdc8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:47.320516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ec30d-5b5f-49b3-8d32-fa0a1e25cdc8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:47.325717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c5ee-2d4e-4466-9969-46942e651522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:47.326390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c5ee-2d4e-4466-9969-46942e651522 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.326674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c5ee-2d4e-4466-9969-46942e651522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.326951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c5ee-2d4e-4466-9969-46942e651522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.327690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4c5ee-2d4e-4466-9969-46942e651522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:47.330226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4c5ee-2d4e-4466-9969-46942e651522 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.356953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1033/2089] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:47 2022] POST /identity/v3/projects => generated 404 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:47.361942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013348c-bbf4-4953-8fa9-90a474cda0cb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:47.373252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013348c-bbf4-4953-8fa9-90a474cda0cb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:47.392635 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c5ee-2d4e-4466-9969-46942e651522 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:47.394365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0db4c5ee-2d4e-4466-9969-46942e651522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:47.440199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7934e-063b-43e1-84e4-6b49116ca118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:47.441007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7934e-063b-43e1-84e4-6b49116ca118 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.441347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7934e-063b-43e1-84e4-6b49116ca118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.441749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7934e-063b-43e1-84e4-6b49116ca118 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.442699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7934e-063b-43e1-84e4-6b49116ca118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:47.444891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7934e-063b-43e1-84e4-6b49116ca118 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.471515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:47.472457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1057/2090] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:47 2022] POST /identity/v3/users => generated 309 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:47.477771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7934e-063b-43e1-84e4-6b49116ca118 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:47.491574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c5ee-2d4e-4466-9969-46942e651522 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:47.492508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7934e-063b-43e1-84e4-6b49116ca118 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:47.496671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:47.497480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.497764 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.498030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] PATH_INFO: `/v3/projects/b02d568e44ff400db8c62dae38893200` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.499118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae268bec-7f75-4c52-978f-99c5c04d7097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:47.499809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae268bec-7f75-4c52-978f-99c5c04d7097 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.500157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae268bec-7f75-4c52-978f-99c5c04d7097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.501008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae268bec-7f75-4c52-978f-99c5c04d7097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.501258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02d568e44ff400db8c62dae38893200)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:47.501744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae268bec-7f75-4c52-978f-99c5c04d7097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:47.503325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae268bec-7f75-4c52-978f-99c5c04d7097 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.503677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.514299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1058/2091] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:47 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:47.518695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae268bec-7f75-4c52-978f-99c5c04d7097 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:47.529059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae268bec-7f75-4c52-978f-99c5c04d7097 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:47.538072 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819dda2-5b29-412e-84f2-c8812820f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:47.539765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819dda2-5b29-412e-84f2-c8812820f309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.540059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819dda2-5b29-412e-84f2-c8812820f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.540342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819dda2-5b29-412e-84f2-c8812820f309 admin admin] PATH_INFO: `/v3/projects/b5f1066d826e4a67bf1ee16d84775ce6/users/8b8057f9364545f2b18543610a25c7bc/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.557590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819dda2-5b29-412e-84f2-c8812820f309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f1066d826e4a67bf1ee16d84775ce6, user_id=8b8057f9364545f2b18543610a25c7bc, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:47.558306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02d568e44ff400db8c62dae38893200', 'request_id': 'req-ef9339d5-27f2-496c-92d2-c375c19b20a7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.560309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819dda2-5b29-412e-84f2-c8812820f309 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.565767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02d568e44ff400db8c62dae38893200', 'request_id': 'req-ef9339d5-27f2-496c-92d2-c375c19b20a7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.582889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02d568e44ff400db8c62dae38893200', 'request_id': 'req-ef9339d5-27f2-496c-92d2-c375c19b20a7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.588777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1059/2092] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:47 2022] PUT /identity/v3/projects/b5f1066d826e4a67bf1ee16d84775ce6/users/8b8057f9364545f2b18543610a25c7bc/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:47.593328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819dda2-5b29-412e-84f2-c8812820f309 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:47.596405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] The token cache is being invalidate because project b02d568e44ff400db8c62dae38893200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:47.596721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.597790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.602860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1034/2093] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:47 2022] DELETE /identity/v3/projects/b02d568e44ff400db8c62dae38893200 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:47.603945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:47.606132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:47.684929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819dda2-5b29-412e-84f2-c8812820f309 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:47.695094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ae829-0110-41ab-9fc5-4033c5350228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:47.695814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ae829-0110-41ab-9fc5-4033c5350228 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.696099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ae829-0110-41ab-9fc5-4033c5350228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.696382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ae829-0110-41ab-9fc5-4033c5350228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.697275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ae829-0110-41ab-9fc5-4033c5350228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:47.698984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ae829-0110-41ab-9fc5-4033c5350228 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.705654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9339d5-27f2-496c-92d2-c375c19b20a7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:47.711348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:47.712351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.712632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.712921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] PATH_INFO: `/v3/users/38328f1695b44e4cacfe4525c98a870f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.715169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38328f1695b44e4cacfe4525c98a870f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:47.717729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.727617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1060/2094] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:47 2022] GET /identity/v3/roles => generated 1427 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:47.732468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ae829-0110-41ab-9fc5-4033c5350228 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:47.734228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4d0ae829-0110-41ab-9fc5-4033c5350228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:47.751103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ae829-0110-41ab-9fc5-4033c5350228 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:47.758390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7355779-7b6b-49fe-9e95-078905a0ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:47.759286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355779-7b6b-49fe-9e95-078905a0ed9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.759594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355779-7b6b-49fe-9e95-078905a0ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.759881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355779-7b6b-49fe-9e95-078905a0ed9f admin admin] PATH_INFO: `/v3/projects/b5f1066d826e4a67bf1ee16d84775ce6/users/8b8057f9364545f2b18543610a25c7bc/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.761913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7355779-7b6b-49fe-9e95-078905a0ed9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f1066d826e4a67bf1ee16d84775ce6, user_id=8b8057f9364545f2b18543610a25c7bc, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:47.764613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7355779-7b6b-49fe-9e95-078905a0ed9f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:47.772190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38328f1695b44e4cacfe4525c98a870f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.772904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38328f1695b44e4cacfe4525c98a870f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.778193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1061/2095] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:47 2022] PUT /identity/v3/projects/b5f1066d826e4a67bf1ee16d84775ce6/users/8b8057f9364545f2b18543610a25c7bc/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:47.788573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38328f1695b44e4cacfe4525c98a870f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.789054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8a41-8a25-4d97-8a0c-b22370b306c6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:47.790063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8a41-8a25-4d97-8a0c-b22370b306c6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:47.790361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8a41-8a25-4d97-8a0c-b22370b306c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:47.797241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38328f1695b44e4cacfe4525c98a870f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.798189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38328f1695b44e4cacfe4525c98a870f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:47.809039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:47.815695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1035/2096] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:47 2022] DELETE /identity/v3/users/38328f1695b44e4cacfe4525c98a870f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:47.822837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e07e8a41-8a25-4d97-8a0c-b22370b306c6 None None] MFA Rules not processed for user `8b8057f9364545f2b18543610a25c7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:47.824212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e07e8a41-8a25-4d97-8a0c-b22370b306c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:47.836588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:47.925434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1062/2097] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:47 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:47.936392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:47.938842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:48.006624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7cf7-e097-4fbf-8c5c-ae59ba5794a4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.006818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7cf7-e097-4fbf-8c5c-ae59ba5794a4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.007323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7cf7-e097-4fbf-8c5c-ae59ba5794a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.031802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-10aa7cf7-e097-4fbf-8c5c-ae59ba5794a4 None None] MFA Rules not processed for user `777390bc7d4c47e3a50c834f13caa15c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:48.032998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-10aa7cf7-e097-4fbf-8c5c-ae59ba5794a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:48.054610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a074570-6a1e-4597-b535-ba736f049cd9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:48.064865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16b05e-1ac5-4768-a45a-406c9f39744d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:48.066600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16b05e-1ac5-4768-a45a-406c9f39744d service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.067114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16b05e-1ac5-4768-a45a-406c9f39744d service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.067477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16b05e-1ac5-4768-a45a-406c9f39744d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.082226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16b05e-1ac5-4768-a45a-406c9f39744d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:48.084302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16b05e-1ac5-4768-a45a-406c9f39744d service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:48.099746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1036/2098] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:47 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:48.111614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1063/2099] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:48.283364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16b05e-1ac5-4768-a45a-406c9f39744d service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:48.286078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8c16b05e-1ac5-4768-a45a-406c9f39744d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:48.301623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7cf7-e097-4fbf-8c5c-ae59ba5794a4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:48.307292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-10aa7cf7-e097-4fbf-8c5c-ae59ba5794a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:48.433752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16b05e-1ac5-4768-a45a-406c9f39744d service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:48.445691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:48.447539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.448244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.448877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] PATH_INFO: `/v3/projects/9947a1041e734b2f9949e5b47edd59ce` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.451462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9947a1041e734b2f9949e5b47edd59ce)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:48.454776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7cf7-e097-4fbf-8c5c-ae59ba5794a4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:48.456161 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:48.462436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:48.463609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.464085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.464859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] PATH_INFO: `/v3/users/f7b1baccf36d446b847441b2746d5588` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.467134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b1baccf36d446b847441b2746d5588)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:48.470972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:48.549636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9947a1041e734b2f9949e5b47edd59ce', 'request_id': 'req-1eebe16c-7de9-4d27-b075-060de56aa465'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.551270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b1baccf36d446b847441b2746d5588'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.552286 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b1baccf36d446b847441b2746d5588'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.556410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9947a1041e734b2f9949e5b47edd59ce', 'request_id': 'req-1eebe16c-7de9-4d27-b075-060de56aa465'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.559071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:48.564922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b1baccf36d446b847441b2746d5588'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.566951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b1baccf36d446b847441b2746d5588'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.569706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9947a1041e734b2f9949e5b47edd59ce', 'request_id': 'req-1eebe16c-7de9-4d27-b075-060de56aa465'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.576562 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4a52d8a5-e841-4e7c-b167-f0b39969d5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b1baccf36d446b847441b2746d5588'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.586040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] The token cache is being invalidate because project 9947a1041e734b2f9949e5b47edd59ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:48.586333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.586994 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1eebe16c-7de9-4d27-b075-060de56aa465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:48.588754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1037/2100] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:48 2022] DELETE /identity/v3/projects/9947a1041e734b2f9949e5b47edd59ce => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:48.594579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd7f66-c441-4c34-a85c-65b32b85d797 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.594866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd7f66-c441-4c34-a85c-65b32b85d797 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.595167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd7f66-c441-4c34-a85c-65b32b85d797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.600510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1064/2101] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:48 2022] DELETE /identity/v3/users/f7b1baccf36d446b847441b2746d5588 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:48.605668 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f2d84-79ad-473b-b7ba-84f3f8a07e98 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.605955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f2d84-79ad-473b-b7ba-84f3f8a07e98 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.606235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f2d84-79ad-473b-b7ba-84f3f8a07e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.615856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fabd7f66-c441-4c34-a85c-65b32b85d797 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:48.617089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fabd7f66-c441-4c34-a85c-65b32b85d797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:48.627784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b51f2d84-79ad-473b-b7ba-84f3f8a07e98 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:48.629274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b51f2d84-79ad-473b-b7ba-84f3f8a07e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:48.651972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:48.686714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1038/2102] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:48.694859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc4bb0-0204-4e73-a95e-650096ace791 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.695155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc4bb0-0204-4e73-a95e-650096ace791 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.695482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc4bb0-0204-4e73-a95e-650096ace791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.697439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1065/2103] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:48.707527 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f2d84-79ad-473b-b7ba-84f3f8a07e98 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:48.709427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b51f2d84-79ad-473b-b7ba-84f3f8a07e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:48.718018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-98dc4bb0-0204-4e73-a95e-650096ace791 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:48.720047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-98dc4bb0-0204-4e73-a95e-650096ace791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:48.734463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1039/2104] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:48.740284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc4bb0-0204-4e73-a95e-650096ace791 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:48.752213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc4bb0-0204-4e73-a95e-650096ace791 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:48.757157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a77c1-5d10-4154-a893-6537128ec7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:48.757954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a77c1-5d10-4154-a893-6537128ec7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.758343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a77c1-5d10-4154-a893-6537128ec7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.758722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a77c1-5d10-4154-a893-6537128ec7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.759692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a77c1-5d10-4154-a893-6537128ec7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:48.760053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a77c1-5d10-4154-a893-6537128ec7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:48.761955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a77c1-5d10-4154-a893-6537128ec7ad admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:48.781316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f2d84-79ad-473b-b7ba-84f3f8a07e98 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:48.785037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1040/2105] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:48.786014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a77c1-5d10-4154-a893-6537128ec7ad admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:48.790432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80e8cb-fce3-47d3-9b65-4c903002acb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:48.791104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80e8cb-fce3-47d3-9b65-4c903002acb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.791388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80e8cb-fce3-47d3-9b65-4c903002acb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.791707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80e8cb-fce3-47d3-9b65-4c903002acb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.805028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a77c1-5d10-4154-a893-6537128ec7ad admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:48.811318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c527543-92f4-4ed3-97b2-2ad0dadfbb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:48.812426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c527543-92f4-4ed3-97b2-2ad0dadfbb11 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.812717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c527543-92f4-4ed3-97b2-2ad0dadfbb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.812915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80e8cb-fce3-47d3-9b65-4c903002acb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:48.813040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c527543-92f4-4ed3-97b2-2ad0dadfbb11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.813898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c527543-92f4-4ed3-97b2-2ad0dadfbb11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:48.814373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80e8cb-fce3-47d3-9b65-4c903002acb4 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:48.816069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c527543-92f4-4ed3-97b2-2ad0dadfbb11 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:48.827830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1066/2106] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:48.850862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1041/2107] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:48 2022] POST /identity/v3/projects => generated 386 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:48.856108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80e8cb-fce3-47d3-9b65-4c903002acb4 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:48.867446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80e8cb-fce3-47d3-9b65-4c903002acb4 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:48.937252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e6f0-56f9-410e-ae07-23eb050d2102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:48.937960 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e6f0-56f9-410e-ae07-23eb050d2102 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.938268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e6f0-56f9-410e-ae07-23eb050d2102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.938543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39e6f0-56f9-410e-ae07-23eb050d2102 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:48.939240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39e6f0-56f9-410e-ae07-23eb050d2102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:48.941637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39e6f0-56f9-410e-ae07-23eb050d2102 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:48.973456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1067/2108] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:48 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:48.974460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c527543-92f4-4ed3-97b2-2ad0dadfbb11 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:48.986398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c527543-92f4-4ed3-97b2-2ad0dadfbb11 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:48.998052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9f4c4-4190-497f-8e06-c6f246637d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:48.998628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9f4c4-4190-497f-8e06-c6f246637d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:48.998911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9f4c4-4190-497f-8e06-c6f246637d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:48.999191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9f4c4-4190-497f-8e06-c6f246637d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:49.000068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9f4c4-4190-497f-8e06-c6f246637d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:49.001733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9f4c4-4190-497f-8e06-c6f246637d64 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:49.018274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1042/2109] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:48 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:49.019895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e6f0-56f9-410e-ae07-23eb050d2102 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:49.025999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:49.033691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39e6f0-56f9-410e-ae07-23eb050d2102 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:49.040039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b89d1-7c0a-41c3-b878-d76eef1bd19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:49.040786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b89d1-7c0a-41c3-b878-d76eef1bd19a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:49.041085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b89d1-7c0a-41c3-b878-d76eef1bd19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:49.041422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b89d1-7c0a-41c3-b878-d76eef1bd19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:49.042283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b89d1-7c0a-41c3-b878-d76eef1bd19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:49.043781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b89d1-7c0a-41c3-b878-d76eef1bd19a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:49.056544 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1068/2110] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:49 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:49.060638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9f4c4-4190-497f-8e06-c6f246637d64 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:49.072046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9f4c4-4190-497f-8e06-c6f246637d64 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:49.079340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a29ee-4a21-45d0-b2eb-6e5c0409ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:49.079680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a29ee-4a21-45d0-b2eb-6e5c0409ebdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:49.079999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a29ee-4a21-45d0-b2eb-6e5c0409ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:49.080278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a29ee-4a21-45d0-b2eb-6e5c0409ebdf admin admin] PATH_INFO: `/v3/projects/fdc27e47228a4d83be29267269b91f88/users/d4edcc5112ff4d828d4723b655ef602d/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:49.100235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a29ee-4a21-45d0-b2eb-6e5c0409ebdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc27e47228a4d83be29267269b91f88, user_id=d4edcc5112ff4d828d4723b655ef602d, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:49.103122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a29ee-4a21-45d0-b2eb-6e5c0409ebdf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:49.132590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1043/2111] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:49 2022] PUT /identity/v3/projects/fdc27e47228a4d83be29267269b91f88/users/d4edcc5112ff4d828d4723b655ef602d/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:49.137455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e8040-525a-4226-be60-fa715fd2b4c4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:49.137854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e8040-525a-4226-be60-fa715fd2b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:49.138018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e8040-525a-4226-be60-fa715fd2b4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:49.160714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a29ee-4a21-45d0-b2eb-6e5c0409ebdf admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:49.163437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bc3a29ee-4a21-45d0-b2eb-6e5c0409ebdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:49.205593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ac6e8040-525a-4226-be60-fa715fd2b4c4 None None] MFA Rules not processed for user `d4edcc5112ff4d828d4723b655ef602d`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:49.207367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ac6e8040-525a-4226-be60-fa715fd2b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:49.265746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a29ee-4a21-45d0-b2eb-6e5c0409ebdf admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:49.271930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:49.272801 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:49.273080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:49.273361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] PATH_INFO: `/v3/projects/7fceba775b9848c5be11ad6f8911a205` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:49.275084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fceba775b9848c5be11ad6f8911a205)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:49.277242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:49.307938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1069/2112] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:49.307938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e8040-525a-4226-be60-fa715fd2b4c4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:49.309692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ac6e8040-525a-4226-be60-fa715fd2b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:49.338716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fceba775b9848c5be11ad6f8911a205', 'request_id': 'req-3949b55a-45b7-430c-b639-47d56b525730'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.345884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fceba775b9848c5be11ad6f8911a205', 'request_id': 'req-3949b55a-45b7-430c-b639-47d56b525730'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.350936 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:49.357713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fceba775b9848c5be11ad6f8911a205', 'request_id': 'req-3949b55a-45b7-430c-b639-47d56b525730'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.373970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] The token cache is being invalidate because project 7fceba775b9848c5be11ad6f8911a205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:49.374271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.374950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.378273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1044/2113] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:49 2022] DELETE /identity/v3/projects/7fceba775b9848c5be11ad6f8911a205 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:49.378449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:49.380136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:49.383965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e8040-525a-4226-be60-fa715fd2b4c4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:49.444652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:49.445388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:49.445669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:49.445948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:49.448182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:49.454994 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b55a-45b7-430c-b639-47d56b525730 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:49.460104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11f1db-dcf3-43a3-871d-273ecdc80069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:49.460766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11f1db-dcf3-43a3-871d-273ecdc80069 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:49.461056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11f1db-dcf3-43a3-871d-273ecdc80069 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:49.461335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11f1db-dcf3-43a3-871d-273ecdc80069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:49.463243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4b11f1db-dcf3-43a3-871d-273ecdc80069 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:49.509652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:49.526511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:49.528013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:49.534289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11f1db-dcf3-43a3-871d-273ecdc80069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:49.536015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11f1db-dcf3-43a3-871d-273ecdc80069 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:49.539620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1070/2114] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:49.540491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:49.541979 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:49.547735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1045/2115] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:49.630341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee7f12-b4f9-486e-a0fc-f2b79d3b3677 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:49.635776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:49.637044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:49.637451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:49.637812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] PATH_INFO: `/v3/users/8b8057f9364545f2b18543610a25c7bc` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:49.639283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8057f9364545f2b18543610a25c7bc)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:49.641677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:49.710013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8057f9364545f2b18543610a25c7bc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.710861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8057f9364545f2b18543610a25c7bc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.721011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8057f9364545f2b18543610a25c7bc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.722274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8057f9364545f2b18543610a25c7bc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.733937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7d70a966-682a-4a74-bf9e-5e9d3ee4b683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8057f9364545f2b18543610a25c7bc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:49.762120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1071/2116] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:49 2022] DELETE /identity/v3/users/8b8057f9364545f2b18543610a25c7bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:50.268014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11f1db-dcf3-43a3-871d-273ecdc80069 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:50.279139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11f1db-dcf3-43a3-871d-273ecdc80069 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:50.351805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:50.352679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.352965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.353254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] PATH_INFO: `/v3/projects/b5f1066d826e4a67bf1ee16d84775ce6` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.354447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f1066d826e4a67bf1ee16d84775ce6)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:50.356728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:50.404658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:50.411899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f1066d826e4a67bf1ee16d84775ce6', 'request_id': 'req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:50.419763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f1066d826e4a67bf1ee16d84775ce6', 'request_id': 'req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:50.428426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f1066d826e4a67bf1ee16d84775ce6', 'request_id': 'req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:50.444030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] The token cache is being invalidate because project b5f1066d826e4a67bf1ee16d84775ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:50.444319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:50.445025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e38b5e50-d08d-48b9-88c8-8b8b3f38fa3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:50.446974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1046/2117] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:50 2022] DELETE /identity/v3/projects/b5f1066d826e4a67bf1ee16d84775ce6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:50.452350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14ef67-9f34-494d-b6f0-41c66f8e6a6c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.452846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14ef67-9f34-494d-b6f0-41c66f8e6a6c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.453026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14ef67-9f34-494d-b6f0-41c66f8e6a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.471874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cb14ef67-9f34-494d-b6f0-41c66f8e6a6c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:50.473074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cb14ef67-9f34-494d-b6f0-41c66f8e6a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:50.542348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1072/2118] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:50.551757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23ff1a-a241-41c0-8dd1-4a9a9ffd6533 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.552375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23ff1a-a241-41c0-8dd1-4a9a9ffd6533 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.552655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23ff1a-a241-41c0-8dd1-4a9a9ffd6533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.572351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5d23ff1a-a241-41c0-8dd1-4a9a9ffd6533 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:50.573667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5d23ff1a-a241-41c0-8dd1-4a9a9ffd6533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:50.586445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1047/2119] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:50.588182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14ef67-9f34-494d-b6f0-41c66f8e6a6c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:50.599300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14ef67-9f34-494d-b6f0-41c66f8e6a6c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:50.603995 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565a463-256b-41e2-9d28-2d93679c7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:50.604650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a463-256b-41e2-9d28-2d93679c7cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.604934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a463-256b-41e2-9d28-2d93679c7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.605492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a463-256b-41e2-9d28-2d93679c7cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.606228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565a463-256b-41e2-9d28-2d93679c7cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:50.606534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565a463-256b-41e2-9d28-2d93679c7cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:50.608224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565a463-256b-41e2-9d28-2d93679c7cc2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:50.610018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:50.626536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1073/2120] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:50.627766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23ff1a-a241-41c0-8dd1-4a9a9ffd6533 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:50.637159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23ff1a-a241-41c0-8dd1-4a9a9ffd6533 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:50.642580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00770cea-0794-49c2-bd69-3372fe3231aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:50.643246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00770cea-0794-49c2-bd69-3372fe3231aa admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.643528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00770cea-0794-49c2-bd69-3372fe3231aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.643841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00770cea-0794-49c2-bd69-3372fe3231aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.644540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00770cea-0794-49c2-bd69-3372fe3231aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:50.646455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00770cea-0794-49c2-bd69-3372fe3231aa admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:50.675594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1048/2121] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:50 2022] POST /identity/v3/projects => generated 404 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:50.678246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565a463-256b-41e2-9d28-2d93679c7cc2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:50.689001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565a463-256b-41e2-9d28-2d93679c7cc2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:50.767323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24afd3-41ef-4b49-a6da-f7c4f60ab0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:50.768167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24afd3-41ef-4b49-a6da-f7c4f60ab0da admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.768571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24afd3-41ef-4b49-a6da-f7c4f60ab0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.768922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24afd3-41ef-4b49-a6da-f7c4f60ab0da admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.769711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24afd3-41ef-4b49-a6da-f7c4f60ab0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:50.771716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24afd3-41ef-4b49-a6da-f7c4f60ab0da admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:50.794118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1074/2122] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:50 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:50.797952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00770cea-0794-49c2-bd69-3372fe3231aa admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:50.809248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00770cea-0794-49c2-bd69-3372fe3231aa admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:50.817207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f187bb-53a2-49b7-b93e-78fd084306aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:50.817899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f187bb-53a2-49b7-b93e-78fd084306aa admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.818187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f187bb-53a2-49b7-b93e-78fd084306aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.818468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f187bb-53a2-49b7-b93e-78fd084306aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.820004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f187bb-53a2-49b7-b93e-78fd084306aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:50.822567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f187bb-53a2-49b7-b93e-78fd084306aa admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:50.835892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1049/2123] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:50 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:50.839687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24afd3-41ef-4b49-a6da-f7c4f60ab0da admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:50.850974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24afd3-41ef-4b49-a6da-f7c4f60ab0da admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:50.856135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4d478-b6dc-4bbc-a8e4-2013e6b90a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:50.856866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4d478-b6dc-4bbc-a8e4-2013e6b90a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.857152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4d478-b6dc-4bbc-a8e4-2013e6b90a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.857434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4d478-b6dc-4bbc-a8e4-2013e6b90a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.858172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4d478-b6dc-4bbc-a8e4-2013e6b90a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:50.859857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4d478-b6dc-4bbc-a8e4-2013e6b90a23 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:50.875848 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1075/2124] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:50 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:50.877336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f187bb-53a2-49b7-b93e-78fd084306aa admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:50.887866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f187bb-53a2-49b7-b93e-78fd084306aa admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:50.893498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ddcf4-ef3d-46bb-a17d-40b6de8ca38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:50.894460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ddcf4-ef3d-46bb-a17d-40b6de8ca38a admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.894816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ddcf4-ef3d-46bb-a17d-40b6de8ca38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.895213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ddcf4-ef3d-46bb-a17d-40b6de8ca38a admin admin] PATH_INFO: `/v3/projects/95a58e0ed97a400aa580ae81460f1cb6/users/78ed076e3cea4079a00f2370c3dadbd3/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.913201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ddcf4-ef3d-46bb-a17d-40b6de8ca38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a58e0ed97a400aa580ae81460f1cb6, user_id=78ed076e3cea4079a00f2370c3dadbd3, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:50.916003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ddcf4-ef3d-46bb-a17d-40b6de8ca38a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:50.933536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1050/2125] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:50 2022] PUT /identity/v3/projects/95a58e0ed97a400aa580ae81460f1cb6/users/78ed076e3cea4079a00f2370c3dadbd3/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:50.943687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cf88d-b498-47db-b16b-d379da4c37f0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:50.944306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cf88d-b498-47db-b16b-d379da4c37f0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:50.944895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cf88d-b498-47db-b16b-d379da4c37f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:50.968970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fa3cf88d-b498-47db-b16b-d379da4c37f0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:50.970195 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa3cf88d-b498-47db-b16b-d379da4c37f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:51.045726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1076/2126] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:51.056367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ddcf4-ef3d-46bb-a17d-40b6de8ca38a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:51.058734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a35ddcf4-ef3d-46bb-a17d-40b6de8ca38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:51.140894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ddcf4-ef3d-46bb-a17d-40b6de8ca38a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:51.146276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d7749-c239-46d8-9e55-bdd5333bebad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:51.147041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7749-c239-46d8-9e55-bdd5333bebad service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:51.147429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7749-c239-46d8-9e55-bdd5333bebad service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:51.147914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7749-c239-46d8-9e55-bdd5333bebad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:51.164263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d7749-c239-46d8-9e55-bdd5333bebad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:51.166103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d7749-c239-46d8-9e55-bdd5333bebad service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:51.185933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1051/2127] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:51.989319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb1bd3-be3f-4380-8c1b-aa89d92c0f5b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:51.989801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb1bd3-be3f-4380-8c1b-aa89d92c0f5b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:51.989917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb1bd3-be3f-4380-8c1b-aa89d92c0f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.029583 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c7eb1bd3-be3f-4380-8c1b-aa89d92c0f5b None None] MFA Rules not processed for user `78ed076e3cea4079a00f2370c3dadbd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:52.031284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c7eb1bd3-be3f-4380-8c1b-aa89d92c0f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:52.113102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1077/2128] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:52.117665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d7749-c239-46d8-9e55-bdd5333bebad service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:52.130110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d7749-c239-46d8-9e55-bdd5333bebad service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:52.136916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3dea8-4caf-4ce6-82c3-68a6d8b70aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:52.138012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3dea8-4caf-4ce6-82c3-68a6d8b70aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:52.138508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3dea8-4caf-4ce6-82c3-68a6d8b70aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:52.138997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3dea8-4caf-4ce6-82c3-68a6d8b70aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.140128 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3dea8-4caf-4ce6-82c3-68a6d8b70aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:52.143395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3dea8-4caf-4ce6-82c3-68a6d8b70aa7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:52.193271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1052/2129] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:52 2022] POST /identity/v3/projects => generated 406 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:52.205028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb1bd3-be3f-4380-8c1b-aa89d92c0f5b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:52.211016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:52.220939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb1bd3-be3f-4380-8c1b-aa89d92c0f5b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:52.291808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74db2c4-7493-41df-9465-aa279d81f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:52.292487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74db2c4-7493-41df-9465-aa279d81f352 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:52.292795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74db2c4-7493-41df-9465-aa279d81f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:52.293155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74db2c4-7493-41df-9465-aa279d81f352 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.293894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74db2c4-7493-41df-9465-aa279d81f352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:52.296234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74db2c4-7493-41df-9465-aa279d81f352 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:52.318125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1078/2130] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:52 2022] POST /identity/v3/users => generated 310 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:52.322648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3dea8-4caf-4ce6-82c3-68a6d8b70aa7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:52.335192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3dea8-4caf-4ce6-82c3-68a6d8b70aa7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:52.342225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02049-2c1b-4f3a-806b-9c05a861c48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:52.342728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02049-2c1b-4f3a-806b-9c05a861c48a admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:52.343413 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02049-2c1b-4f3a-806b-9c05a861c48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:52.343883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d02049-2c1b-4f3a-806b-9c05a861c48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.344692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d02049-2c1b-4f3a-806b-9c05a861c48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:52.346435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d02049-2c1b-4f3a-806b-9c05a861c48a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:52.359654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1053/2131] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:52 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:52.362740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02049-2c1b-4f3a-806b-9c05a861c48a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:52.362856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74db2c4-7493-41df-9465-aa279d81f352 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:52.364556 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c74db2c4-7493-41df-9465-aa279d81f352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:52.375975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d02049-2c1b-4f3a-806b-9c05a861c48a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:52.377883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74db2c4-7493-41df-9465-aa279d81f352 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:52.381947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1827-b527-4082-87fa-ad783464d25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:52.382836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:52.382988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1827-b527-4082-87fa-ad783464d25c admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:52.383185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1827-b527-4082-87fa-ad783464d25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:52.383517 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1827-b527-4082-87fa-ad783464d25c admin admin] PATH_INFO: `/v3/projects/c3cd1b82108340a7828223f2c05a05d7/users/95188ddcfb5249799ce23ca5163f2710/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.383982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:52.384340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:52.384692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] PATH_INFO: `/v3/users/d4edcc5112ff4d828d4723b655ef602d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.386000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4edcc5112ff4d828d4723b655ef602d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:52.388201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:52.402146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df1827-b527-4082-87fa-ad783464d25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cd1b82108340a7828223f2c05a05d7, user_id=95188ddcfb5249799ce23ca5163f2710, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:52.405466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df1827-b527-4082-87fa-ad783464d25c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:52.422195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1054/2132] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:52 2022] PUT /identity/v3/projects/c3cd1b82108340a7828223f2c05a05d7/users/95188ddcfb5249799ce23ca5163f2710/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:52.426282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1827-b527-4082-87fa-ad783464d25c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:52.448141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:52.453046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4edcc5112ff4d828d4723b655ef602d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:52.454314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4edcc5112ff4d828d4723b655ef602d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:52.462401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4edcc5112ff4d828d4723b655ef602d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:52.463157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4edcc5112ff4d828d4723b655ef602d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:52.475535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-65fe07cd-94d2-4c71-ba70-1e1926afad65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4edcc5112ff4d828d4723b655ef602d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:52.498885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1079/2133] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:52 2022] DELETE /identity/v3/users/d4edcc5112ff4d828d4723b655ef602d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:52.503836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d65b88-c425-4c47-be77-99f1540031b9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:52.504183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d65b88-c425-4c47-be77-99f1540031b9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:52.504533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d65b88-c425-4c47-be77-99f1540031b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.527307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1827-b527-4082-87fa-ad783464d25c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:52.528731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-59d65b88-c425-4c47-be77-99f1540031b9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:52.530602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-59d65b88-c425-4c47-be77-99f1540031b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:52.598986 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553b07-9a59-4bc9-9a40-49bf9e7adee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:52.600326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553b07-9a59-4bc9-9a40-49bf9e7adee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:52.600617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553b07-9a59-4bc9-9a40-49bf9e7adee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:52.600898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553b07-9a59-4bc9-9a40-49bf9e7adee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.601911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553b07-9a59-4bc9-9a40-49bf9e7adee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:52.603859 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553b07-9a59-4bc9-9a40-49bf9e7adee1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:52.607829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1080/2134] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:52.618297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1055/2135] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:52 2022] GET /identity/v3/roles => generated 1427 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:52.622327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d65b88-c425-4c47-be77-99f1540031b9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:52.623842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-59d65b88-c425-4c47-be77-99f1540031b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:52.628504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553b07-9a59-4bc9-9a40-49bf9e7adee1 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:52.643061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3f553b07-9a59-4bc9-9a40-49bf9e7adee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:52.643194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:52.643194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d65b88-c425-4c47-be77-99f1540031b9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:52.645465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da219fe-4121-407d-b569-0b17f95571d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:52.646519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da219fe-4121-407d-b569-0b17f95571d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:52.647476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da219fe-4121-407d-b569-0b17f95571d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:52.648128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da219fe-4121-407d-b569-0b17f95571d4 admin admin] PATH_INFO: `/v3/projects/c3cd1b82108340a7828223f2c05a05d7/users/95188ddcfb5249799ce23ca5163f2710/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.651251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da219fe-4121-407d-b569-0b17f95571d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cd1b82108340a7828223f2c05a05d7, user_id=95188ddcfb5249799ce23ca5163f2710, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:52.654861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da219fe-4121-407d-b569-0b17f95571d4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:52.667109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1081/2136] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:52 2022] PUT /identity/v3/projects/c3cd1b82108340a7828223f2c05a05d7/users/95188ddcfb5249799ce23ca5163f2710/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:52.704178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553b07-9a59-4bc9-9a40-49bf9e7adee1 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:52.767431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21abfc-0060-45ca-b9b6-d5b4dad063e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:52.768301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21abfc-0060-45ca-b9b6-d5b4dad063e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:52.768832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21abfc-0060-45ca-b9b6-d5b4dad063e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:52.769151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21abfc-0060-45ca-b9b6-d5b4dad063e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:52.799529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:52.849243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21abfc-0060-45ca-b9b6-d5b4dad063e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:52.850753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21abfc-0060-45ca-b9b6-d5b4dad063e3 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:52.863986 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1056/2137] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:53.291994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da219fe-4121-407d-b569-0b17f95571d4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:53.295110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2da219fe-4121-407d-b569-0b17f95571d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:53.318012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da219fe-4121-407d-b569-0b17f95571d4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:53.332311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:53.333383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:53.334114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:53.334632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] PATH_INFO: `/v3/projects/fdc27e47228a4d83be29267269b91f88` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:53.337029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc27e47228a4d83be29267269b91f88)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:53.341141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:53.408487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc27e47228a4d83be29267269b91f88', 'request_id': 'req-c8017ac3-0429-46a6-8ca2-14c13ba84500'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:53.417655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc27e47228a4d83be29267269b91f88', 'request_id': 'req-c8017ac3-0429-46a6-8ca2-14c13ba84500'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:53.426612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc27e47228a4d83be29267269b91f88', 'request_id': 'req-c8017ac3-0429-46a6-8ca2-14c13ba84500'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:53.438277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] The token cache is being invalidate because project fdc27e47228a4d83be29267269b91f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:53.438650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:53.439249 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c8017ac3-0429-46a6-8ca2-14c13ba84500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:53.441201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1082/2138] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:53 2022] DELETE /identity/v3/projects/fdc27e47228a4d83be29267269b91f88 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:53.446282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb35c-c79d-4a12-8d82-1e0c0f418941 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:53.446769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb35c-c79d-4a12-8d82-1e0c0f418941 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:53.446889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb35c-c79d-4a12-8d82-1e0c0f418941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:53.467167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-22bbb35c-c79d-4a12-8d82-1e0c0f418941 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:53.468479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-22bbb35c-c79d-4a12-8d82-1e0c0f418941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:53.538323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1057/2139] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:53.546023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dfef3-6da6-4497-a69f-cc660db8c56c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:53.546320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dfef3-6da6-4497-a69f-cc660db8c56c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:53.547153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dfef3-6da6-4497-a69f-cc660db8c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:53.573603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3b6dfef3-6da6-4497-a69f-cc660db8c56c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:53.574840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3b6dfef3-6da6-4497-a69f-cc660db8c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:53.584491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1083/2140] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:53.589041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb35c-c79d-4a12-8d82-1e0c0f418941 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:53.601367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb35c-c79d-4a12-8d82-1e0c0f418941 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:53.608315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930dabc-d944-4688-9562-fd45818f16a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:53.608641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930dabc-d944-4688-9562-fd45818f16a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:53.608932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930dabc-d944-4688-9562-fd45818f16a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:53.609211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930dabc-d944-4688-9562-fd45818f16a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:53.610463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930dabc-d944-4688-9562-fd45818f16a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:53.610939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930dabc-d944-4688-9562-fd45818f16a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:53.612714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930dabc-d944-4688-9562-fd45818f16a4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:53.639153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1058/2141] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:53.640586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dfef3-6da6-4497-a69f-cc660db8c56c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:53.663531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dfef3-6da6-4497-a69f-cc660db8c56c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:53.675114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463ffd-442e-4c97-9122-3b751e78e828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:53.676903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463ffd-442e-4c97-9122-3b751e78e828 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:53.677229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463ffd-442e-4c97-9122-3b751e78e828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:53.677510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463ffd-442e-4c97-9122-3b751e78e828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:53.680340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff463ffd-442e-4c97-9122-3b751e78e828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:53.684314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024761a-5ff5-49e1-95cb-8c21140964d4 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:53.684411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024761a-5ff5-49e1-95cb-8c21140964d4 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:53.684849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024761a-5ff5-49e1-95cb-8c21140964d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:53.686709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff463ffd-442e-4c97-9122-3b751e78e828 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:53.736164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2024761a-5ff5-49e1-95cb-8c21140964d4 None None] MFA Rules not processed for user `95188ddcfb5249799ce23ca5163f2710`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:53.738640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2024761a-5ff5-49e1-95cb-8c21140964d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:53.739931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1084/2142] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:53 2022] POST /identity/v3/projects => generated 366 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:53.744355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463ffd-442e-4c97-9122-3b751e78e828 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:53.858555 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463ffd-442e-4c97-9122-3b751e78e828 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:53.864606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871123-b398-46d7-b77a-51f01569d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:53.865531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871123-b398-46d7-b77a-51f01569d661 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:53.865820 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871123-b398-46d7-b77a-51f01569d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:53.866352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871123-b398-46d7-b77a-51f01569d661 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:53.867198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac871123-b398-46d7-b77a-51f01569d661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:53.869931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac871123-b398-46d7-b77a-51f01569d661 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:53.871516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1059/2143] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:53.904727 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1085/2144] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:53 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:53.911899 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024761a-5ff5-49e1-95cb-8c21140964d4 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:53.927370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024761a-5ff5-49e1-95cb-8c21140964d4 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:53.934677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1d331-33d7-45eb-9c92-2a6d1871a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:53.935729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1d331-33d7-45eb-9c92-2a6d1871a15f admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:53.936615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1d331-33d7-45eb-9c92-2a6d1871a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:53.936908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1d331-33d7-45eb-9c92-2a6d1871a15f admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:53.938794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1d331-33d7-45eb-9c92-2a6d1871a15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:53.940476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1d331-33d7-45eb-9c92-2a6d1871a15f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:53.955777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1060/2145] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:53 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:53.959726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871123-b398-46d7-b77a-51f01569d661 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:53.976017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871123-b398-46d7-b77a-51f01569d661 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:53.981911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ba21-88f9-44ef-86c3-52ff7843d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:53.982616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ba21-88f9-44ef-86c3-52ff7843d131 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:53.982907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ba21-88f9-44ef-86c3-52ff7843d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:53.983245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ba21-88f9-44ef-86c3-52ff7843d131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:53.984353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5ba21-88f9-44ef-86c3-52ff7843d131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:53.986709 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5ba21-88f9-44ef-86c3-52ff7843d131 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:54.004668 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1086/2146] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:53 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:54.006050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1d331-33d7-45eb-9c92-2a6d1871a15f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:54.019368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1d331-33d7-45eb-9c92-2a6d1871a15f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:54.025852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be022f-cd9a-4de9-aa56-c6c1990b3ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:54.026746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be022f-cd9a-4de9-aa56-c6c1990b3ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:54.027034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be022f-cd9a-4de9-aa56-c6c1990b3ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:54.027312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be022f-cd9a-4de9-aa56-c6c1990b3ad6 admin admin] PATH_INFO: `/v3/projects/9d220870b4434ee5921d3cefa70d62f9/users/095ce5b8fd4848beaf10bf64b16284f7/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:54.046219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be022f-cd9a-4de9-aa56-c6c1990b3ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d220870b4434ee5921d3cefa70d62f9, user_id=095ce5b8fd4848beaf10bf64b16284f7, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:54.050083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be022f-cd9a-4de9-aa56-c6c1990b3ad6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:54.060573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:54.067818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1061/2147] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:54 2022] PUT /identity/v3/projects/9d220870b4434ee5921d3cefa70d62f9/users/095ce5b8fd4848beaf10bf64b16284f7/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:54.078371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671495d-2254-49aa-9530-dedb164e7dee None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:54.078759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671495d-2254-49aa-9530-dedb164e7dee None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:54.079066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671495d-2254-49aa-9530-dedb164e7dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:54.108270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0671495d-2254-49aa-9530-dedb164e7dee None None] MFA Rules not processed for user `095ce5b8fd4848beaf10bf64b16284f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:54.110019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0671495d-2254-49aa-9530-dedb164e7dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:54.123809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:54.203040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1087/2148] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:54.214263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be022f-cd9a-4de9-aa56-c6c1990b3ad6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:54.216069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-18be022f-cd9a-4de9-aa56-c6c1990b3ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:54.278767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be022f-cd9a-4de9-aa56-c6c1990b3ad6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:54.283084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d58628-e194-402f-907a-ef7c1ba25cf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:54.283780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58628-e194-402f-907a-ef7c1ba25cf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:54.284070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58628-e194-402f-907a-ef7c1ba25cf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:54.284353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58628-e194-402f-907a-ef7c1ba25cf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:54.293102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d58628-e194-402f-907a-ef7c1ba25cf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:54.294550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d58628-e194-402f-907a-ef7c1ba25cf5 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:54.304757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1062/2149] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:54.538535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0bea6-2127-4761-bc87-844b996f70d7 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:54.539037 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0bea6-2127-4761-bc87-844b996f70d7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:54.539258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0bea6-2127-4761-bc87-844b996f70d7 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:54.541206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1088/2150] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:28:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:28:54.567058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda40ad-7d5e-4282-8863-90638152350b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:54.567578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda40ad-7d5e-4282-8863-90638152350b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:54.567666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda40ad-7d5e-4282-8863-90638152350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:54.591180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3bda40ad-7d5e-4282-8863-90638152350b None None] MFA Rules not processed for user `88e5d3ba49164f55a063aa60643bd421`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:54.593730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3bda40ad-7d5e-4282-8863-90638152350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:54.716756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1063/2151] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:28:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:54.927646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0bea6-2127-4761-bc87-844b996f70d7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:54.929604 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f4e0bea6-2127-4761-bc87-844b996f70d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:54.939334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda40ad-7d5e-4282-8863-90638152350b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:54.942157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3bda40ad-7d5e-4282-8863-90638152350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:54.965169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda40ad-7d5e-4282-8863-90638152350b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:54.971003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c712a8-73e2-408a-b62f-d2af7a920b96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:54.971875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c712a8-73e2-408a-b62f-d2af7a920b96 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:54.972275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c712a8-73e2-408a-b62f-d2af7a920b96 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:54.972618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c712a8-73e2-408a-b62f-d2af7a920b96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:54.982694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c712a8-73e2-408a-b62f-d2af7a920b96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:54.985271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c712a8-73e2-408a-b62f-d2af7a920b96 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:54.997547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1064/2152] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:28:55.049804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0bea6-2127-4761-bc87-844b996f70d7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:55.058151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:55.059289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:55.059595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:55.059882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] PATH_INFO: `/v3/users/8163f12a685a495ea5c3783db45c3aed` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:55.061319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8163f12a685a495ea5c3783db45c3aed)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:55.064281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:55.136692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8163f12a685a495ea5c3783db45c3aed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.138009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8163f12a685a495ea5c3783db45c3aed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.148311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8163f12a685a495ea5c3783db45c3aed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.149187 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8163f12a685a495ea5c3783db45c3aed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.161804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8163f12a685a495ea5c3783db45c3aed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.186440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1089/2153] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:54 2022] DELETE /identity/v3/users/8163f12a685a495ea5c3783db45c3aed => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:55.192082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cfe31-145d-4873-864c-8abf5b993f6a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:55.192443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cfe31-145d-4873-864c-8abf5b993f6a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:55.192796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cfe31-145d-4873-864c-8abf5b993f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:55.212187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ab5cfe31-145d-4873-864c-8abf5b993f6a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:55.213600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ab5cfe31-145d-4873-864c-8abf5b993f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:55.280890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1065/2154] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:55.291120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:55.292884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:55.332107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:55.358205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689e62d-7562-4592-8da6-31aec1db0a0b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:55.362585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd5ed2-f6d6-4891-b9a0-1a88f8bf6a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:55.363232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd5ed2-f6d6-4891-b9a0-1a88f8bf6a3a service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:55.363518 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd5ed2-f6d6-4891-b9a0-1a88f8bf6a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:55.363826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd5ed2-f6d6-4891-b9a0-1a88f8bf6a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:55.373327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd5ed2-f6d6-4891-b9a0-1a88f8bf6a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:55.374771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd5ed2-f6d6-4891-b9a0-1a88f8bf6a3a service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:55.384760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1090/2155] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:55.600484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cfe31-145d-4873-864c-8abf5b993f6a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:55.601987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ab5cfe31-145d-4873-864c-8abf5b993f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:55.614500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cfe31-145d-4873-864c-8abf5b993f6a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:55.619210 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:55.620205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:55.620560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:55.620911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] PATH_INFO: `/v3/users/78ed076e3cea4079a00f2370c3dadbd3` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:55.622925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ed076e3cea4079a00f2370c3dadbd3)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:55.625012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:55.648642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:55.680707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd5ed2-f6d6-4891-b9a0-1a88f8bf6a3a service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:55.682240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-11dd5ed2-f6d6-4891-b9a0-1a88f8bf6a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:55.683410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ed076e3cea4079a00f2370c3dadbd3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.684387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ed076e3cea4079a00f2370c3dadbd3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.705199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ed076e3cea4079a00f2370c3dadbd3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.712477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd5ed2-f6d6-4891-b9a0-1a88f8bf6a3a service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:55.714793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ed076e3cea4079a00f2370c3dadbd3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.715616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ed076e3cea4079a00f2370c3dadbd3'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.718595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:55.720104 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:55.720385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:55.720931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] PATH_INFO: `/v3/projects/3b03110ecb66433895fe9135cab130b4` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:55.724767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b03110ecb66433895fe9135cab130b4)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:55.727259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:55.735162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1066/2156] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:55 2022] DELETE /identity/v3/users/78ed076e3cea4079a00f2370c3dadbd3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:55.785362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b03110ecb66433895fe9135cab130b4', 'request_id': 'req-11ed1352-cc94-48bd-9719-5206ce0e05c5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.794108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b03110ecb66433895fe9135cab130b4', 'request_id': 'req-11ed1352-cc94-48bd-9719-5206ce0e05c5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.803895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b03110ecb66433895fe9135cab130b4', 'request_id': 'req-11ed1352-cc94-48bd-9719-5206ce0e05c5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.817866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] The token cache is being invalidate because project 3b03110ecb66433895fe9135cab130b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:55.818217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.820098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:55.821930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1091/2157] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:55 2022] DELETE /identity/v3/projects/3b03110ecb66433895fe9135cab130b4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:55.825722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:55.827291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:55.918217 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e3121-5a8f-4afa-8135-c1f3acb11ef1 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:55.936768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:55.938748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:56.020471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:56.021347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:56.021631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:56.021913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] PATH_INFO: `/v3/users/b601ce63da99406f9ea7be48ec6a3b2e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:56.023176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b601ce63da99406f9ea7be48ec6a3b2e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:56.025265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:56.035398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1352-cc94-48bd-9719-5206ce0e05c5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:56.041045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:56.041500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:56.041794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:56.042077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] PATH_INFO: `/v3/projects/95a58e0ed97a400aa580ae81460f1cb6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:56.043277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a58e0ed97a400aa580ae81460f1cb6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:56.045255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:56.080762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b601ce63da99406f9ea7be48ec6a3b2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.081639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b601ce63da99406f9ea7be48ec6a3b2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.083027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:56.099615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b601ce63da99406f9ea7be48ec6a3b2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.109581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b601ce63da99406f9ea7be48ec6a3b2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.110427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b601ce63da99406f9ea7be48ec6a3b2e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.124237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a58e0ed97a400aa580ae81460f1cb6', 'request_id': 'req-150ae04e-8a06-49f6-9a6c-bd5967697ff0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.127771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1067/2158] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:55 2022] DELETE /identity/v3/users/b601ce63da99406f9ea7be48ec6a3b2e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:56.138673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a58e0ed97a400aa580ae81460f1cb6', 'request_id': 'req-150ae04e-8a06-49f6-9a6c-bd5967697ff0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.149667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a58e0ed97a400aa580ae81460f1cb6', 'request_id': 'req-150ae04e-8a06-49f6-9a6c-bd5967697ff0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.152985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:56.175137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] The token cache is being invalidate because project 95a58e0ed97a400aa580ae81460f1cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:56.175623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.176536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.179303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1092/2159] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:55 2022] DELETE /identity/v3/projects/95a58e0ed97a400aa580ae81460f1cb6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:56.183361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:56.185722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:56.300280 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d318aaf-2857-4116-87d3-063496a72dae admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:56.306201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:56.306201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:56.308503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:56.308503 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] PATH_INFO: `/v3/users/95188ddcfb5249799ce23ca5163f2710` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:56.309441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95188ddcfb5249799ce23ca5163f2710)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:56.312128 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:56.369700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95188ddcfb5249799ce23ca5163f2710'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.370375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95188ddcfb5249799ce23ca5163f2710'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.383207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95188ddcfb5249799ce23ca5163f2710'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.390410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95188ddcfb5249799ce23ca5163f2710'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.391664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95188ddcfb5249799ce23ca5163f2710'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.413642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1068/2160] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:28:56 2022] DELETE /identity/v3/users/95188ddcfb5249799ce23ca5163f2710 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:56.576504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:56.578575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:56.676822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:56.678991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:56.704350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ae04e-8a06-49f6-9a6c-bd5967697ff0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:56.743321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:56.776095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310e8c-7d9a-4b3d-b5f3-3a2c90499c61 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:56.781120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:56.782757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:56.783052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:56.783331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] PATH_INFO: `/v3/projects/c3cd1b82108340a7828223f2c05a05d7` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:56.784585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cd1b82108340a7828223f2c05a05d7)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:56.786651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:56.787185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:56.788619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:56.789699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:56.790164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] PATH_INFO: `/v3/projects/8c862b3264b540f9a43ad7dd9458deeb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:56.791634 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c862b3264b540f9a43ad7dd9458deeb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:56.793923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:56.850962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c862b3264b540f9a43ad7dd9458deeb', 'request_id': 'req-98cf3e80-8b6b-49d4-afa1-491684680ff0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.857807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cd1b82108340a7828223f2c05a05d7', 'request_id': 'req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.858064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c862b3264b540f9a43ad7dd9458deeb', 'request_id': 'req-98cf3e80-8b6b-49d4-afa1-491684680ff0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.865249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cd1b82108340a7828223f2c05a05d7', 'request_id': 'req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.866596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c862b3264b540f9a43ad7dd9458deeb', 'request_id': 'req-98cf3e80-8b6b-49d4-afa1-491684680ff0'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.873126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cd1b82108340a7828223f2c05a05d7', 'request_id': 'req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.880813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] The token cache is being invalidate because project 8c862b3264b540f9a43ad7dd9458deeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:56.881135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.882341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98cf3e80-8b6b-49d4-afa1-491684680ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.887643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1093/2161] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:56 2022] DELETE /identity/v3/projects/8c862b3264b540f9a43ad7dd9458deeb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:56.888047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] The token cache is being invalidate because project c3cd1b82108340a7828223f2c05a05d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:28:56.888047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.888852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-59c29018-e439-4f21-9fe9-8f0ec4b0e63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:28:56.893681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa0c85-8f34-42eb-ba18-8d87b36e5bef None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:56.893831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1069/2162] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:28:56 2022] DELETE /identity/v3/projects/c3cd1b82108340a7828223f2c05a05d7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:56.893914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa0c85-8f34-42eb-ba18-8d87b36e5bef None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:56.893914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa0c85-8f34-42eb-ba18-8d87b36e5bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:56.896082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad8554-79f8-408f-a85e-6510de023226 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:56.896929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad8554-79f8-408f-a85e-6510de023226 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:56.897223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad8554-79f8-408f-a85e-6510de023226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:56.911508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-41aa0c85-8f34-42eb-ba18-8d87b36e5bef None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:56.912824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-41aa0c85-8f34-42eb-ba18-8d87b36e5bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:56.919415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-65ad8554-79f8-408f-a85e-6510de023226 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:56.920933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-65ad8554-79f8-408f-a85e-6510de023226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:56.941012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:56.985719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1094/2163] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:56.988882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1070/2164] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:56.993919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf0240-4d32-47c0-9a43-eb1b483760d4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:56.994503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf0240-4d32-47c0-9a43-eb1b483760d4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:56.994800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf0240-4d32-47c0-9a43-eb1b483760d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:56.996319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7a11e-f7b9-4e9e-8e9c-18d39a970a6b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:56.996636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7a11e-f7b9-4e9e-8e9c-18d39a970a6b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:56.997019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7a11e-f7b9-4e9e-8e9c-18d39a970a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.015866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0aa7a11e-f7b9-4e9e-8e9c-18d39a970a6b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:57.016074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-94bf0240-4d32-47c0-9a43-eb1b483760d4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:57.017185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-94bf0240-4d32-47c0-9a43-eb1b483760d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:57.017331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0aa7a11e-f7b9-4e9e-8e9c-18d39a970a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:57.025374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1095/2165] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:57.028602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1071/2166] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:57.029446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf0240-4d32-47c0-9a43-eb1b483760d4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.029581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7a11e-f7b9-4e9e-8e9c-18d39a970a6b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.039387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf0240-4d32-47c0-9a43-eb1b483760d4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.039592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7a11e-f7b9-4e9e-8e9c-18d39a970a6b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.044070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e8e1-f0e1-4c46-b64c-3c67da57bc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.044206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb81fb-9e00-4f89-a5ab-a767b675a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.044739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e8e1-f0e1-4c46-b64c-3c67da57bc6d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.044837 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb81fb-9e00-4f89-a5ab-a767b675a08c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.045019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e8e1-f0e1-4c46-b64c-3c67da57bc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.045131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb81fb-9e00-4f89-a5ab-a767b675a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.045297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e8e1-f0e1-4c46-b64c-3c67da57bc6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.045393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb81fb-9e00-4f89-a5ab-a767b675a08c admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.046017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e8e1-f0e1-4c46-b64c-3c67da57bc6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:57.046119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb81fb-9e00-4f89-a5ab-a767b675a08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:28:57.046321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e8e1-f0e1-4c46-b64c-3c67da57bc6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.046417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb81fb-9e00-4f89-a5ab-a767b675a08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.048509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e8e1-f0e1-4c46-b64c-3c67da57bc6d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.048641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb81fb-9e00-4f89-a5ab-a767b675a08c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.064430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1096/2168] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:28:57.064627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1072/2168] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:28:57.065605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e8e1-f0e1-4c46-b64c-3c67da57bc6d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.068929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb81fb-9e00-4f89-a5ab-a767b675a08c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.076043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e8e1-f0e1-4c46-b64c-3c67da57bc6d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.079214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb81fb-9e00-4f89-a5ab-a767b675a08c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.081519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96d14-7880-43f6-96aa-aa91d4da24ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.082173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96d14-7880-43f6-96aa-aa91d4da24ff admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.082489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96d14-7880-43f6-96aa-aa91d4da24ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.082795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff96d14-7880-43f6-96aa-aa91d4da24ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.083520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff96d14-7880-43f6-96aa-aa91d4da24ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.083880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a4ffc-43cd-4f4e-bc19-4e34785269ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.084516 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a4ffc-43cd-4f4e-bc19-4e34785269ac admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.084796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a4ffc-43cd-4f4e-bc19-4e34785269ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.085072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a4ffc-43cd-4f4e-bc19-4e34785269ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.085484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff96d14-7880-43f6-96aa-aa91d4da24ff admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.085795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a4ffc-43cd-4f4e-bc19-4e34785269ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.087700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a4ffc-43cd-4f4e-bc19-4e34785269ac admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.115863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1097/2169] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/projects => generated 386 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:57.116310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1073/2170] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/projects => generated 382 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:57.120378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a4ffc-43cd-4f4e-bc19-4e34785269ac admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.125436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96d14-7880-43f6-96aa-aa91d4da24ff admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.156817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:57.194041 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a4ffc-43cd-4f4e-bc19-4e34785269ac admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.194864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff96d14-7880-43f6-96aa-aa91d4da24ff admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.198935 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c782d-3ce4-4933-95f9-8c1d33b1b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.199517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b18455-4cc2-4ff8-884c-6fae7b76af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.199725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c782d-3ce4-4933-95f9-8c1d33b1b0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.200017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c782d-3ce4-4933-95f9-8c1d33b1b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.200210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b18455-4cc2-4ff8-884c-6fae7b76af66 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.200305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c782d-3ce4-4933-95f9-8c1d33b1b0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.200501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b18455-4cc2-4ff8-884c-6fae7b76af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.200761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b18455-4cc2-4ff8-884c-6fae7b76af66 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.201011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c782d-3ce4-4933-95f9-8c1d33b1b0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.201449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b18455-4cc2-4ff8-884c-6fae7b76af66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.203014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c782d-3ce4-4933-95f9-8c1d33b1b0c7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.203358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b18455-4cc2-4ff8-884c-6fae7b76af66 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.226345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1098/2171] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:57.229976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1074/2172] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:57.233338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b18455-4cc2-4ff8-884c-6fae7b76af66 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.234065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c782d-3ce4-4933-95f9-8c1d33b1b0c7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.244107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b18455-4cc2-4ff8-884c-6fae7b76af66 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.244737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c782d-3ce4-4933-95f9-8c1d33b1b0c7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.248877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7a2bb-c13e-4a0e-9ea3-60cb843bbe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.249540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7a2bb-c13e-4a0e-9ea3-60cb843bbe4f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.249776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd51a13-91a0-4688-bc52-df7bb422a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.249944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7a2bb-c13e-4a0e-9ea3-60cb843bbe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.250657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7a2bb-c13e-4a0e-9ea3-60cb843bbe4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.251073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51a13-91a0-4688-bc52-df7bb422a70d admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.251358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51a13-91a0-4688-bc52-df7bb422a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.251461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7a2bb-c13e-4a0e-9ea3-60cb843bbe4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.251666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51a13-91a0-4688-bc52-df7bb422a70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.252999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd51a13-91a0-4688-bc52-df7bb422a70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.253115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7a2bb-c13e-4a0e-9ea3-60cb843bbe4f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.256059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd51a13-91a0-4688-bc52-df7bb422a70d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.263617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1099/2173] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:57.267531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7a2bb-c13e-4a0e-9ea3-60cb843bbe4f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.268435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1075/2174] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:57.272546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd51a13-91a0-4688-bc52-df7bb422a70d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.278703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7a2bb-c13e-4a0e-9ea3-60cb843bbe4f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.282858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd51a13-91a0-4688-bc52-df7bb422a70d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.283690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71a15-4a83-48fc-8616-0fbbc792c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.284372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71a15-4a83-48fc-8616-0fbbc792c578 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.284638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71a15-4a83-48fc-8616-0fbbc792c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.284915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71a15-4a83-48fc-8616-0fbbc792c578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.285648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b71a15-4a83-48fc-8616-0fbbc792c578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.287576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b71a15-4a83-48fc-8616-0fbbc792c578 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.288204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafaa74-8dbf-4bf4-9cb9-405c173ac799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.288977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafaa74-8dbf-4bf4-9cb9-405c173ac799 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.289321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafaa74-8dbf-4bf4-9cb9-405c173ac799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.290023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafaa74-8dbf-4bf4-9cb9-405c173ac799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.290479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafaa74-8dbf-4bf4-9cb9-405c173ac799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.292196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafaa74-8dbf-4bf4-9cb9-405c173ac799 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.299489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1100/2175] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:57.303599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71a15-4a83-48fc-8616-0fbbc792c578 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.305311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1076/2176] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:57.309402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafaa74-8dbf-4bf4-9cb9-405c173ac799 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.315133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71a15-4a83-48fc-8616-0fbbc792c578 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.321129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafaa74-8dbf-4bf4-9cb9-405c173ac799 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.327901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a8232-22db-4fd6-9dce-3cf239959f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.328982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a8232-22db-4fd6-9dce-3cf239959f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.329266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a8232-22db-4fd6-9dce-3cf239959f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.329540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a8232-22db-4fd6-9dce-3cf239959f9a admin admin] PATH_INFO: `/v3/projects/f726d69dcb31457083b5f93f1143266a/users/081e16802783410f922f81cbd6490be1/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.331327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba645-0cab-4721-bc2c-de1c80ff1105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.332305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba645-0cab-4721-bc2c-de1c80ff1105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.332601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba645-0cab-4721-bc2c-de1c80ff1105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.332883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba645-0cab-4721-bc2c-de1c80ff1105 admin admin] PATH_INFO: `/v3/projects/cd31f57e5dd94cc595423b6c611d8e1c/users/2e0247d0b41d4278b0c24d9824c2943e/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.347910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a8232-22db-4fd6-9dce-3cf239959f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f726d69dcb31457083b5f93f1143266a, user_id=081e16802783410f922f81cbd6490be1, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.349010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba645-0cab-4721-bc2c-de1c80ff1105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd31f57e5dd94cc595423b6c611d8e1c, user_id=2e0247d0b41d4278b0c24d9824c2943e, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.350592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a8232-22db-4fd6-9dce-3cf239959f9a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.351690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba645-0cab-4721-bc2c-de1c80ff1105 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.371786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1101/2177] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:57 2022] PUT /identity/v3/projects/f726d69dcb31457083b5f93f1143266a/users/081e16802783410f922f81cbd6490be1/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:57.392913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1077/2178] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:57 2022] PUT /identity/v3/projects/cd31f57e5dd94cc595423b6c611d8e1c/users/2e0247d0b41d4278b0c24d9824c2943e/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:57.393404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f905-64ab-49d4-9da4-c74c3075838a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.393404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f905-64ab-49d4-9da4-c74c3075838a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.393404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841f905-64ab-49d4-9da4-c74c3075838a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.395974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eaf8d-b3d9-4771-8660-de9901c0ab2c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.396282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eaf8d-b3d9-4771-8660-de9901c0ab2c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.396543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7eaf8d-b3d9-4771-8660-de9901c0ab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.427266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0c7eaf8d-b3d9-4771-8660-de9901c0ab2c None None] MFA Rules not processed for user `2e0247d0b41d4278b0c24d9824c2943e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:57.428723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0c7eaf8d-b3d9-4771-8660-de9901c0ab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:57.428858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f841f905-64ab-49d4-9da4-c74c3075838a None None] MFA Rules not processed for user `081e16802783410f922f81cbd6490be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:57.430237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f841f905-64ab-49d4-9da4-c74c3075838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:57.452599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:57.522907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1102/2179] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:57.525111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1078/2180] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:57.527446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f905-64ab-49d4-9da4-c74c3075838a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.531001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7eaf8d-b3d9-4771-8660-de9901c0ab2c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.602988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7eaf8d-b3d9-4771-8660-de9901c0ab2c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.603184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841f905-64ab-49d4-9da4-c74c3075838a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.607906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52e4f4-7556-4113-ab9e-697c5d5b146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.608391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe455-91b4-40d3-9e96-ad67a0b44ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.608564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52e4f4-7556-4113-ab9e-697c5d5b146e admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.608901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52e4f4-7556-4113-ab9e-697c5d5b146e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.609057 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe455-91b4-40d3-9e96-ad67a0b44ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.609191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52e4f4-7556-4113-ab9e-697c5d5b146e admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.609922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe455-91b4-40d3-9e96-ad67a0b44ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.610208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe455-91b4-40d3-9e96-ad67a0b44ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.610607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52e4f4-7556-4113-ab9e-697c5d5b146e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.610906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abe455-91b4-40d3-9e96-ad67a0b44ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.612561 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52e4f4-7556-4113-ab9e-697c5d5b146e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.612873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abe455-91b4-40d3-9e96-ad67a0b44ff5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.623817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:57.642052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1079/2181] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/projects => generated 380 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:57.643358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1103/2182] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/projects => generated 382 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:28:57.647125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52e4f4-7556-4113-ab9e-697c5d5b146e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.650023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe455-91b4-40d3-9e96-ad67a0b44ff5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.725440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52e4f4-7556-4113-ab9e-697c5d5b146e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.752102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe455-91b4-40d3-9e96-ad67a0b44ff5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.756378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83d006-2846-4098-90d4-5e42493a2f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.757115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83d006-2846-4098-90d4-5e42493a2f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.757426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83d006-2846-4098-90d4-5e42493a2f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.757672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83d006-2846-4098-90d4-5e42493a2f17 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.758377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83d006-2846-4098-90d4-5e42493a2f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.760352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83d006-2846-4098-90d4-5e42493a2f17 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.784455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1104/2183] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:57.788475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83d006-2846-4098-90d4-5e42493a2f17 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.791902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413fea-4610-4fca-a392-280ba7415094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.792699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413fea-4610-4fca-a392-280ba7415094 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.793001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413fea-4610-4fca-a392-280ba7415094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.793691 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413fea-4610-4fca-a392-280ba7415094 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.793969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413fea-4610-4fca-a392-280ba7415094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.797787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413fea-4610-4fca-a392-280ba7415094 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.800284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83d006-2846-4098-90d4-5e42493a2f17 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.805099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bcc99-3e67-4264-a98b-652d9a33657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.805764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bcc99-3e67-4264-a98b-652d9a33657b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.806052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bcc99-3e67-4264-a98b-652d9a33657b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.806332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bcc99-3e67-4264-a98b-652d9a33657b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.807069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21bcc99-3e67-4264-a98b-652d9a33657b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.809834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21bcc99-3e67-4264-a98b-652d9a33657b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.821871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1080/2184] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:57 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:57.822840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1105/2185] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:57.826173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413fea-4610-4fca-a392-280ba7415094 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.829245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bcc99-3e67-4264-a98b-652d9a33657b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.837969 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413fea-4610-4fca-a392-280ba7415094 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.842176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bcc99-3e67-4264-a98b-652d9a33657b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.843122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623a4a-2d55-44e2-9fd0-20ab269185f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.843933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623a4a-2d55-44e2-9fd0-20ab269185f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.844681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623a4a-2d55-44e2-9fd0-20ab269185f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.844960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623a4a-2d55-44e2-9fd0-20ab269185f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.845707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f623a4a-2d55-44e2-9fd0-20ab269185f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.847344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f623a4a-2d55-44e2-9fd0-20ab269185f8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.848914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0303-75a5-455f-9fe0-a190881c2154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.849996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0303-75a5-455f-9fe0-a190881c2154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.850282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0303-75a5-455f-9fe0-a190881c2154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.850568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a0303-75a5-455f-9fe0-a190881c2154 admin admin] PATH_INFO: `/v3/projects/77cae67f07b44ec0956816d22435a05d/users/6622aa8d1df544d8ab63d99282a6fbce/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.860955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1081/2186] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:57.865235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623a4a-2d55-44e2-9fd0-20ab269185f8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.868633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0303-75a5-455f-9fe0-a190881c2154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cae67f07b44ec0956816d22435a05d, user_id=6622aa8d1df544d8ab63d99282a6fbce, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.871674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a0303-75a5-455f-9fe0-a190881c2154 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.876892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623a4a-2d55-44e2-9fd0-20ab269185f8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.882746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:57.883569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af26e6-d0a3-43d5-abbb-d7b3fb19232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.884343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af26e6-d0a3-43d5-abbb-d7b3fb19232e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.884834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af26e6-d0a3-43d5-abbb-d7b3fb19232e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.885378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af26e6-d0a3-43d5-abbb-d7b3fb19232e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.886084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af26e6-d0a3-43d5-abbb-d7b3fb19232e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.887751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af26e6-d0a3-43d5-abbb-d7b3fb19232e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.888845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1106/2187] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:57 2022] PUT /identity/v3/projects/77cae67f07b44ec0956816d22435a05d/users/6622aa8d1df544d8ab63d99282a6fbce/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:28:57.893524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0303-75a5-455f-9fe0-a190881c2154 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.900318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1082/2188] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:57.904433 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af26e6-d0a3-43d5-abbb-d7b3fb19232e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.916719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af26e6-d0a3-43d5-abbb-d7b3fb19232e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.968382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a0303-75a5-455f-9fe0-a190881c2154 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:57.974066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b672f-d904-491a-ae03-8eb897390bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.974740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b672f-d904-491a-ae03-8eb897390bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.975026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b672f-d904-491a-ae03-8eb897390bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.975366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b672f-d904-491a-ae03-8eb897390bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.976081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b672f-d904-491a-ae03-8eb897390bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:57.977156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e365a-67e6-483e-a2b4-e7cba687c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:57.977732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b672f-d904-491a-ae03-8eb897390bcf admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:57.978021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e365a-67e6-483e-a2b4-e7cba687c981 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:57.978311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e365a-67e6-483e-a2b4-e7cba687c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:57.978652 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e365a-67e6-483e-a2b4-e7cba687c981 admin admin] PATH_INFO: `/v3/projects/a4951223bc7b4ec583998afe0cbbb687/users/617a63b1ba364d8abfb2525b0975f6ab/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:57.988768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1107/2189] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:57 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:57.993004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b672f-d904-491a-ae03-8eb897390bcf admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:57.993144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:57.998679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e365a-67e6-483e-a2b4-e7cba687c981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4951223bc7b4ec583998afe0cbbb687, user_id=617a63b1ba364d8abfb2525b0975f6ab, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.001715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e365a-67e6-483e-a2b4-e7cba687c981 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.003181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b672f-d904-491a-ae03-8eb897390bcf admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.008768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eccbdb-8700-43fc-b123-5bdd573a63df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.009712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eccbdb-8700-43fc-b123-5bdd573a63df admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.010028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eccbdb-8700-43fc-b123-5bdd573a63df admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.010313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eccbdb-8700-43fc-b123-5bdd573a63df admin admin] PATH_INFO: `/v3/projects/77cae67f07b44ec0956816d22435a05d/users/6622aa8d1df544d8ab63d99282a6fbce/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.012451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eccbdb-8700-43fc-b123-5bdd573a63df admin admin] RBAC: Authorizing `identity:create_grant(project_id=77cae67f07b44ec0956816d22435a05d, user_id=6622aa8d1df544d8ab63d99282a6fbce, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.015094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eccbdb-8700-43fc-b123-5bdd573a63df admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.019789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1083/2190] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:57 2022] PUT /identity/v3/projects/a4951223bc7b4ec583998afe0cbbb687/users/617a63b1ba364d8abfb2525b0975f6ab/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:58.026961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1108/2191] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:57 2022] PUT /identity/v3/projects/77cae67f07b44ec0956816d22435a05d/users/6622aa8d1df544d8ab63d99282a6fbce/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:58.034018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013dcf-9d2b-4fdd-8a4e-be6f065c9f2a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.034310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013dcf-9d2b-4fdd-8a4e-be6f065c9f2a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.034590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58013dcf-9d2b-4fdd-8a4e-be6f065c9f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.037678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18160-a058-4e24-a175-51bff70cc85d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.037978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18160-a058-4e24-a175-51bff70cc85d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.038261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18160-a058-4e24-a175-51bff70cc85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.067118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9de18160-a058-4e24-a175-51bff70cc85d None None] MFA Rules not processed for user `6622aa8d1df544d8ab63d99282a6fbce`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:58.070106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-58013dcf-9d2b-4fdd-8a4e-be6f065c9f2a None None] MFA Rules not processed for user `617a63b1ba364d8abfb2525b0975f6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:58.070212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9de18160-a058-4e24-a175-51bff70cc85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:58.070405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-58013dcf-9d2b-4fdd-8a4e-be6f065c9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:58.133902 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1084/2192] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:58.138313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013dcf-9d2b-4fdd-8a4e-be6f065c9f2a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:58.139591 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1109/2193] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:28:58.151473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18160-a058-4e24-a175-51bff70cc85d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:58.152904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9de18160-a058-4e24-a175-51bff70cc85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:58.210240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58013dcf-9d2b-4fdd-8a4e-be6f065c9f2a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.212435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18160-a058-4e24-a175-51bff70cc85d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.215325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272134f-b59a-4dd4-8344-21c95f3fa93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.216045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272134f-b59a-4dd4-8344-21c95f3fa93d admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.216164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c33dd7-108a-4787-872f-5c28c4a2af79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.216327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272134f-b59a-4dd4-8344-21c95f3fa93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.216626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272134f-b59a-4dd4-8344-21c95f3fa93d admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.216775 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c33dd7-108a-4787-872f-5c28c4a2af79 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.217058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c33dd7-108a-4787-872f-5c28c4a2af79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.217298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272134f-b59a-4dd4-8344-21c95f3fa93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.217392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c33dd7-108a-4787-872f-5c28c4a2af79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.219312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272134f-b59a-4dd4-8344-21c95f3fa93d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.227031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c33dd7-108a-4787-872f-5c28c4a2af79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.228592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c33dd7-108a-4787-872f-5c28c4a2af79 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.239723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1110/2194] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:58.251593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1085/2195] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:28:58 2022] POST /identity/v3/projects => generated 384 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:58.253722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c33dd7-108a-4787-872f-5c28c4a2af79 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:58.264888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c33dd7-108a-4787-872f-5c28c4a2af79 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.271100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:58.317982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272134f-b59a-4dd4-8344-21c95f3fa93d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:58.334454 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754169f-ccc8-42b2-99f0-6899cadb3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.335341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754169f-ccc8-42b2-99f0-6899cadb3107 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.335673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754169f-ccc8-42b2-99f0-6899cadb3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.335958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754169f-ccc8-42b2-99f0-6899cadb3107 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.336669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754169f-ccc8-42b2-99f0-6899cadb3107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.339028 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754169f-ccc8-42b2-99f0-6899cadb3107 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.360139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1111/2196] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:28:58 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:28:58.364411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754169f-ccc8-42b2-99f0-6899cadb3107 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:58.374262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754169f-ccc8-42b2-99f0-6899cadb3107 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.376657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272134f-b59a-4dd4-8344-21c95f3fa93d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.379809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73635-f8ce-4a00-9a2a-32b7cab80df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.380337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d52d34-3ae5-499f-8aef-f3fa02790da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.380447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73635-f8ce-4a00-9a2a-32b7cab80df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.380731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73635-f8ce-4a00-9a2a-32b7cab80df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.381006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d73635-f8ce-4a00-9a2a-32b7cab80df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.381100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d52d34-3ae5-499f-8aef-f3fa02790da6 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.381323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d52d34-3ae5-499f-8aef-f3fa02790da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.381603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d52d34-3ae5-499f-8aef-f3fa02790da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.381732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d73635-f8ce-4a00-9a2a-32b7cab80df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.383329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d73635-f8ce-4a00-9a2a-32b7cab80df6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.394215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1112/2197] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:28:58.398327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73635-f8ce-4a00-9a2a-32b7cab80df6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:58.399891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:58.408064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d73635-f8ce-4a00-9a2a-32b7cab80df6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.413034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5ae3-661b-45b0-8692-f7422ff25929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.413907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5ae3-661b-45b0-8692-f7422ff25929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.414194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5ae3-661b-45b0-8692-f7422ff25929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.414473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5ae3-661b-45b0-8692-f7422ff25929 admin admin] PATH_INFO: `/v3/projects/02732badcef4446e9b794b8c229d3602/users/ffba32799133434e86da317dceaa9749/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.429968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa5ae3-661b-45b0-8692-f7422ff25929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02732badcef4446e9b794b8c229d3602, user_id=ffba32799133434e86da317dceaa9749, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.432720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa5ae3-661b-45b0-8692-f7422ff25929 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.445213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d52d34-3ae5-499f-8aef-f3fa02790da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.446753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d52d34-3ae5-499f-8aef-f3fa02790da6 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.448828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1113/2198] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:58 2022] PUT /identity/v3/projects/02732badcef4446e9b794b8c229d3602/users/ffba32799133434e86da317dceaa9749/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:58.453034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5ae3-661b-45b0-8692-f7422ff25929 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:58.456805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1086/2199] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:28:58.524065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5ae3-661b-45b0-8692-f7422ff25929 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.528761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3277009-ae89-4d82-91fd-1b43f3d673f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.529431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3277009-ae89-4d82-91fd-1b43f3d673f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.529712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3277009-ae89-4d82-91fd-1b43f3d673f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.529992 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3277009-ae89-4d82-91fd-1b43f3d673f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.530726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3277009-ae89-4d82-91fd-1b43f3d673f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.532440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3277009-ae89-4d82-91fd-1b43f3d673f2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.543452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1114/2200] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:28:58 2022] GET /identity/v3/roles => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:28:58.548711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d52d34-3ae5-499f-8aef-f3fa02790da6 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:58.561834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d52d34-3ae5-499f-8aef-f3fa02790da6 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.576896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8c747-3240-4b0c-b317-a922f2137fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.577855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8c747-3240-4b0c-b317-a922f2137fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.579333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8c747-3240-4b0c-b317-a922f2137fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.580451 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8c747-3240-4b0c-b317-a922f2137fcb admin admin] PATH_INFO: `/v3/projects/02732badcef4446e9b794b8c229d3602/users/ffba32799133434e86da317dceaa9749/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.583823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8c747-3240-4b0c-b317-a922f2137fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=02732badcef4446e9b794b8c229d3602, user_id=ffba32799133434e86da317dceaa9749, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.586838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8c747-3240-4b0c-b317-a922f2137fcb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.603828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1087/2201] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:28:58 2022] PUT /identity/v3/projects/02732badcef4446e9b794b8c229d3602/users/ffba32799133434e86da317dceaa9749/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:28:58.611583 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956832e8-100f-40ce-a8c6-754e3fc90b9c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.611911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956832e8-100f-40ce-a8c6-754e3fc90b9c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.612180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956832e8-100f-40ce-a8c6-754e3fc90b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.651062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-956832e8-100f-40ce-a8c6-754e3fc90b9c None None] MFA Rules not processed for user `ffba32799133434e86da317dceaa9749`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:28:58.652635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-956832e8-100f-40ce-a8c6-754e3fc90b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:28:58.728725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:58.766505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1115/2202] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:28:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:28:58.780947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8c747-3240-4b0c-b317-a922f2137fcb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:28:58.839907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8c747-3240-4b0c-b317-a922f2137fcb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:28:58.843678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570399-8383-4841-adca-ed534f0b31d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:28:58.844322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570399-8383-4841-adca-ed534f0b31d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:28:58.844604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570399-8383-4841-adca-ed534f0b31d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:28:58.844880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44570399-8383-4841-adca-ed534f0b31d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:28:58.907047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570399-8383-4841-adca-ed534f0b31d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:28:58.908664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44570399-8383-4841-adca-ed534f0b31d4 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:28:58.919524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1088/2203] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:28:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:00.434819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956832e8-100f-40ce-a8c6-754e3fc90b9c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:00.446320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956832e8-100f-40ce-a8c6-754e3fc90b9c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:00.450320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9e85-ce6e-4876-ae2a-9464393d3221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:00.451021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9e85-ce6e-4876-ae2a-9464393d3221 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:00.451347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9e85-ce6e-4876-ae2a-9464393d3221 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:00.451664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d9e85-ce6e-4876-ae2a-9464393d3221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:00.511199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9e85-ce6e-4876-ae2a-9464393d3221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:00.512678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d9e85-ce6e-4876-ae2a-9464393d3221 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:00.522521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1116/2204] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:01.056645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570399-8383-4841-adca-ed534f0b31d4 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:01.066305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44570399-8383-4841-adca-ed534f0b31d4 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:01.070425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9feb4-3d63-42dd-96f5-c3464bddb6ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:01.071181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9feb4-3d63-42dd-96f5-c3464bddb6ca service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:01.071487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9feb4-3d63-42dd-96f5-c3464bddb6ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:01.071751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9feb4-3d63-42dd-96f5-c3464bddb6ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:01.081472 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9feb4-3d63-42dd-96f5-c3464bddb6ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:01.083036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9feb4-3d63-42dd-96f5-c3464bddb6ca service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:01.092949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1089/2205] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:05.042243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9e85-ce6e-4876-ae2a-9464393d3221 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:05.118050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d9e85-ce6e-4876-ae2a-9464393d3221 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:05.123277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:05.124245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:05.124526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:05.124805 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] PATH_INFO: `/v3/users/081e16802783410f922f81cbd6490be1` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:05.126075 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] RBAC: Authorizing `identity:delete_user(user_id=081e16802783410f922f81cbd6490be1)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:05.128293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:05.199539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081e16802783410f922f81cbd6490be1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.200337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081e16802783410f922f81cbd6490be1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.209026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081e16802783410f922f81cbd6490be1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.209893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081e16802783410f922f81cbd6490be1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.218956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081e16802783410f922f81cbd6490be1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.244633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1117/2206] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:05 2022] DELETE /identity/v3/users/081e16802783410f922f81cbd6490be1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:05.250421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50889183-50e3-45b6-9952-6ce99da449d8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:05.250972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50889183-50e3-45b6-9952-6ce99da449d8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:05.251056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50889183-50e3-45b6-9952-6ce99da449d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:05.272737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-50889183-50e3-45b6-9952-6ce99da449d8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:05.274218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-50889183-50e3-45b6-9952-6ce99da449d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:05.339398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:05.360672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1090/2207] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:05.371297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:05.372738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:05.378971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:05.438627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d22e7-3dbc-4520-a694-0e1643cc047f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:05.442456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5b47-9f12-43d7-95b5-208d2e32f29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:05.443141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5b47-9f12-43d7-95b5-208d2e32f29c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:05.443425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5b47-9f12-43d7-95b5-208d2e32f29c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:05.443737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5b47-9f12-43d7-95b5-208d2e32f29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:05.453846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5b47-9f12-43d7-95b5-208d2e32f29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:05.455923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5b47-9f12-43d7-95b5-208d2e32f29c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:05.465881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1118/2208] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:05.696050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50889183-50e3-45b6-9952-6ce99da449d8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:05.697546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-50889183-50e3-45b6-9952-6ce99da449d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:05.712094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50889183-50e3-45b6-9952-6ce99da449d8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:05.721719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:05.722602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:05.722963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:05.723284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] PATH_INFO: `/v3/users/2e0247d0b41d4278b0c24d9824c2943e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:05.724542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0247d0b41d4278b0c24d9824c2943e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:05.726543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:05.782696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0247d0b41d4278b0c24d9824c2943e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.783366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0247d0b41d4278b0c24d9824c2943e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.789164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5b47-9f12-43d7-95b5-208d2e32f29c service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:05.791769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c35a5b47-9f12-43d7-95b5-208d2e32f29c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:05.800347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0247d0b41d4278b0c24d9824c2943e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.809428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0247d0b41d4278b0c24d9824c2943e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.810418 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c360e067-521c-4604-ad29-a84ae3f71288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0247d0b41d4278b0c24d9824c2943e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.810546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5b47-9f12-43d7-95b5-208d2e32f29c service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:05.817196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:05.818193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:05.818510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:05.818794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] PATH_INFO: `/v3/projects/f726d69dcb31457083b5f93f1143266a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:05.820972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f726d69dcb31457083b5f93f1143266a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:05.823752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:05.830160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1091/2209] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:05 2022] DELETE /identity/v3/users/2e0247d0b41d4278b0c24d9824c2943e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:05.834724 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e404-e29f-42c7-a021-880d8c2d47ff None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:05.835010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e404-e29f-42c7-a021-880d8c2d47ff None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:05.835450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e404-e29f-42c7-a021-880d8c2d47ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:05.854334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-35a9e404-e29f-42c7-a021-880d8c2d47ff None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:05.855835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-35a9e404-e29f-42c7-a021-880d8c2d47ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:05.876410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f726d69dcb31457083b5f93f1143266a', 'request_id': 'req-ade8ce0d-3114-4f58-8e3d-23e865499087'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.882687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f726d69dcb31457083b5f93f1143266a', 'request_id': 'req-ade8ce0d-3114-4f58-8e3d-23e865499087'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.891932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f726d69dcb31457083b5f93f1143266a', 'request_id': 'req-ade8ce0d-3114-4f58-8e3d-23e865499087'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.904862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] The token cache is being invalidate because project f726d69dcb31457083b5f93f1143266a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:05.905159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.905809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:05.907963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1119/2210] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:05 2022] DELETE /identity/v3/projects/f726d69dcb31457083b5f93f1143266a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:29:05.912834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:05.914301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:05.926074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1092/2211] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:29:05.936759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e404-e29f-42c7-a021-880d8c2d47ff None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:05.938710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-35a9e404-e29f-42c7-a021-880d8c2d47ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:05.984606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8ce0d-3114-4f58-8e3d-23e865499087 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:05.990557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:05.991436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:05.991754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:05.992023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] PATH_INFO: `/v3/users/617a63b1ba364d8abfb2525b0975f6ab` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:05.993361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617a63b1ba364d8abfb2525b0975f6ab)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:05.995293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:06.003897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e404-e29f-42c7-a021-880d8c2d47ff None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:06.017729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:06.032768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:06.048557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617a63b1ba364d8abfb2525b0975f6ab'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.049317 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617a63b1ba364d8abfb2525b0975f6ab'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.056931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617a63b1ba364d8abfb2525b0975f6ab'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.057813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617a63b1ba364d8abfb2525b0975f6ab'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.059804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:06.060520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:06.060808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:06.061086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:06.063127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:06.066406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c79e940d-2bcb-4ca9-966a-b7d277901b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617a63b1ba364d8abfb2525b0975f6ab'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.077022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:06.078488 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:06.086005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1120/2212] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:05 2022] DELETE /identity/v3/users/617a63b1ba364d8abfb2525b0975f6ab => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:29:06.088712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1093/2213] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:29:06.270900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e0fb-ffce-4dbc-a2c7-2648eb54c6ff None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:06.271341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e0fb-ffce-4dbc-a2c7-2648eb54c6ff None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:06.271852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e0fb-ffce-4dbc-a2c7-2648eb54c6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:06.294865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0ed9e0fb-ffce-4dbc-a2c7-2648eb54c6ff None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:06.296409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0ed9e0fb-ffce-4dbc-a2c7-2648eb54c6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:06.380221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1121/2214] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:29:06.431048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:06.431048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:06.432786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9e0fb-ffce-4dbc-a2c7-2648eb54c6ff None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:06.435529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0ed9e0fb-ffce-4dbc-a2c7-2648eb54c6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:06.538253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9e0fb-ffce-4dbc-a2c7-2648eb54c6ff None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:06.547020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a899190-f4ce-4296-a321-828990f63725 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:06.548734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:06.549680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:06.549957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:06.551612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] PATH_INFO: `/v3/projects/cd31f57e5dd94cc595423b6c611d8e1c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:06.551612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd31f57e5dd94cc595423b6c611d8e1c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:06.553660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:06.613276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd31f57e5dd94cc595423b6c611d8e1c', 'request_id': 'req-758db79f-7274-4ae8-b308-45c71b8ef490'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.619941 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd31f57e5dd94cc595423b6c611d8e1c', 'request_id': 'req-758db79f-7274-4ae8-b308-45c71b8ef490'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.621875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:06.634719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bbf14-3c50-4b2e-b77d-180eb608d59b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:06.635372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbf14-3c50-4b2e-b77d-180eb608d59b service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:06.635688 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbf14-3c50-4b2e-b77d-180eb608d59b service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:06.635992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbf14-3c50-4b2e-b77d-180eb608d59b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:06.636900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd31f57e5dd94cc595423b6c611d8e1c', 'request_id': 'req-758db79f-7274-4ae8-b308-45c71b8ef490'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.647879 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bbf14-3c50-4b2e-b77d-180eb608d59b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:06.650942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bbf14-3c50-4b2e-b77d-180eb608d59b service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:06.655184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] The token cache is being invalidate because project cd31f57e5dd94cc595423b6c611d8e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:06.655744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.656680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.659624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1122/2215] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:06 2022] DELETE /identity/v3/projects/cd31f57e5dd94cc595423b6c611d8e1c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:06.660898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:06.662275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:06.667689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1094/2216] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:29:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:29:06.668871 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bbf14-3c50-4b2e-b77d-180eb608d59b service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:06.691504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bbf14-3c50-4b2e-b77d-180eb608d59b service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:06.843823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758db79f-7274-4ae8-b308-45c71b8ef490 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:06.849032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:06.849919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:06.850204 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:06.850484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] PATH_INFO: `/v3/projects/a4951223bc7b4ec583998afe0cbbb687` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:06.853729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4951223bc7b4ec583998afe0cbbb687)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:06.856030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:06.899898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:06.915421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:06.916332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:06.916613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:06.916946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] PATH_INFO: `/v3/users/6622aa8d1df544d8ab63d99282a6fbce` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:06.918527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6622aa8d1df544d8ab63d99282a6fbce)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:06.921352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:06.944452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4951223bc7b4ec583998afe0cbbb687', 'request_id': 'req-ef162ffc-84c9-429b-9aef-44abf8291afa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.954520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4951223bc7b4ec583998afe0cbbb687', 'request_id': 'req-ef162ffc-84c9-429b-9aef-44abf8291afa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.964659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4951223bc7b4ec583998afe0cbbb687', 'request_id': 'req-ef162ffc-84c9-429b-9aef-44abf8291afa'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.988857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] The token cache is being invalidate because project a4951223bc7b4ec583998afe0cbbb687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:06.989896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.990917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:06.993661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1123/2217] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:06 2022] DELETE /identity/v3/projects/a4951223bc7b4ec583998afe0cbbb687 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:07.012415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:07.029431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:07.037878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6622aa8d1df544d8ab63d99282a6fbce'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.038722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6622aa8d1df544d8ab63d99282a6fbce'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.066815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6622aa8d1df544d8ab63d99282a6fbce'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.084336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6622aa8d1df544d8ab63d99282a6fbce'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.085474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6622aa8d1df544d8ab63d99282a6fbce'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.107610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1095/2218] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:06 2022] DELETE /identity/v3/users/6622aa8d1df544d8ab63d99282a6fbce => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:07.152269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef162ffc-84c9-429b-9aef-44abf8291afa admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:07.192902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:07.297664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:07.298612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:07.298903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:07.299234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] PATH_INFO: `/v3/users/ffba32799133434e86da317dceaa9749` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:07.300846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffba32799133434e86da317dceaa9749)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:07.306270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:07.416460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffba32799133434e86da317dceaa9749'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.418290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffba32799133434e86da317dceaa9749'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.429772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffba32799133434e86da317dceaa9749'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.431221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffba32799133434e86da317dceaa9749'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.447834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffba32799133434e86da317dceaa9749'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:07.492068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1124/2219] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:07 2022] DELETE /identity/v3/users/ffba32799133434e86da317dceaa9749 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:07.796893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:07.798462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:07.824942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a652ca-1b18-4a1b-a4ed-9bc5d2a13921 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:07.970857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:07.971763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:07.972050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:07.972326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] PATH_INFO: `/v3/projects/77cae67f07b44ec0956816d22435a05d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:07.973532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77cae67f07b44ec0956816d22435a05d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:07.975973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.086424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.088594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:08.098582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77cae67f07b44ec0956816d22435a05d', 'request_id': 'req-fcdf023f-8677-4061-bccb-68c4c1f50b7e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.119055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77cae67f07b44ec0956816d22435a05d', 'request_id': 'req-fcdf023f-8677-4061-bccb-68c4c1f50b7e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.122044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded6f0-feba-4e24-a0f6-64dc0682827b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.145293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77cae67f07b44ec0956816d22435a05d', 'request_id': 'req-fcdf023f-8677-4061-bccb-68c4c1f50b7e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.165044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:08.171385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] The token cache is being invalidate because project 77cae67f07b44ec0956816d22435a05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:08.171385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.172053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fcdf023f-8677-4061-bccb-68c4c1f50b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.180134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1096/2220] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:07 2022] DELETE /identity/v3/projects/77cae67f07b44ec0956816d22435a05d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:08.190352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc43df-2849-4884-b348-3474fc266909 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.190639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc43df-2849-4884-b348-3474fc266909 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.196033 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc43df-2849-4884-b348-3474fc266909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.223048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c5bc43df-2849-4884-b348-3474fc266909 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:08.224424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c5bc43df-2849-4884-b348-3474fc266909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:08.293869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.295730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.296372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.296908 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] PATH_INFO: `/v3/projects/02732badcef4446e9b794b8c229d3602` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.299469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02732badcef4446e9b794b8c229d3602)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.303511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.339250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1097/2221] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:08.349476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550420eb-006a-49f6-9d25-2e8ec00569cd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.349761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550420eb-006a-49f6-9d25-2e8ec00569cd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.350023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550420eb-006a-49f6-9d25-2e8ec00569cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.387261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-550420eb-006a-49f6-9d25-2e8ec00569cd None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:08.389094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-550420eb-006a-49f6-9d25-2e8ec00569cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:08.398300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:08.415205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02732badcef4446e9b794b8c229d3602', 'request_id': 'req-317dcf84-6a6f-4f12-a597-ed31527de896'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.426466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02732badcef4446e9b794b8c229d3602', 'request_id': 'req-317dcf84-6a6f-4f12-a597-ed31527de896'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.440264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02732badcef4446e9b794b8c229d3602', 'request_id': 'req-317dcf84-6a6f-4f12-a597-ed31527de896'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.455181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] The token cache is being invalidate because project 02732badcef4446e9b794b8c229d3602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:08.455750 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.462345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-317dcf84-6a6f-4f12-a597-ed31527de896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:08.465324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1125/2222] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:08 2022] DELETE /identity/v3/projects/02732badcef4446e9b794b8c229d3602 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:08.479612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74267d96-973e-4aa1-91db-583e86f27703 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.480566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74267d96-973e-4aa1-91db-583e86f27703 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.480566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74267d96-973e-4aa1-91db-583e86f27703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.506624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1098/2223] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:08.511676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550420eb-006a-49f6-9d25-2e8ec00569cd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.512357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-74267d96-973e-4aa1-91db-583e86f27703 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:08.513589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-74267d96-973e-4aa1-91db-583e86f27703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:08.531589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1126/2224] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:08.532476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550420eb-006a-49f6-9d25-2e8ec00569cd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.533433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412f260-cbc8-4dbc-acc4-af65dd4f0792 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.533724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412f260-cbc8-4dbc-acc4-af65dd4f0792 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.534013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412f260-cbc8-4dbc-acc4-af65dd4f0792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.539351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963ff9-4e5e-409a-ad4c-368651ddbee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.540303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963ff9-4e5e-409a-ad4c-368651ddbee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.540589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963ff9-4e5e-409a-ad4c-368651ddbee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.540870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963ff9-4e5e-409a-ad4c-368651ddbee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.541673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f963ff9-4e5e-409a-ad4c-368651ddbee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:29:08.542018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f963ff9-4e5e-409a-ad4c-368651ddbee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.543766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f963ff9-4e5e-409a-ad4c-368651ddbee2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.555822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2412f260-cbc8-4dbc-acc4-af65dd4f0792 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:08.557442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2412f260-cbc8-4dbc-acc4-af65dd4f0792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:08.560737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1099/2225] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:29:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:29:08.565719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963ff9-4e5e-409a-ad4c-368651ddbee2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.567675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1127/2226] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:29:08.570789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412f260-cbc8-4dbc-acc4-af65dd4f0792 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.583427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963ff9-4e5e-409a-ad4c-368651ddbee2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.584153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412f260-cbc8-4dbc-acc4-af65dd4f0792 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.588944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c504c12-4df0-4ec4-a1d2-c4cf232ab717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.589236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73bece-4ade-4578-bf69-5e8c79956bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.589834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c504c12-4df0-4ec4-a1d2-c4cf232ab717 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.589971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73bece-4ade-4578-bf69-5e8c79956bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.590183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73bece-4ade-4578-bf69-5e8c79956bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.590308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c504c12-4df0-4ec4-a1d2-c4cf232ab717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.590483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73bece-4ade-4578-bf69-5e8c79956bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.590732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c504c12-4df0-4ec4-a1d2-c4cf232ab717 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.591159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73bece-4ade-4578-bf69-5e8c79956bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:29:08.591446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73bece-4ade-4578-bf69-5e8c79956bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.591698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c504c12-4df0-4ec4-a1d2-c4cf232ab717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.593204 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73bece-4ade-4578-bf69-5e8c79956bb5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.593974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c504c12-4df0-4ec4-a1d2-c4cf232ab717 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.611597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1128/2227] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:29:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:29:08.614871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73bece-4ade-4578-bf69-5e8c79956bb5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.635196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73bece-4ade-4578-bf69-5e8c79956bb5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.640809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694a0ee-919a-4d8b-9a2a-eedf31fb56b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.641630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694a0ee-919a-4d8b-9a2a-eedf31fb56b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.645169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1100/2228] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:08 2022] POST /identity/v3/projects => generated 366 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:29:08.645341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694a0ee-919a-4d8b-9a2a-eedf31fb56b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.645341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694a0ee-919a-4d8b-9a2a-eedf31fb56b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.645341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694a0ee-919a-4d8b-9a2a-eedf31fb56b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.647329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694a0ee-919a-4d8b-9a2a-eedf31fb56b6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.647689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c504c12-4df0-4ec4-a1d2-c4cf232ab717 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.710672 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1129/2229] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:08 2022] POST /identity/v3/projects => generated 374 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:08.717751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694a0ee-919a-4d8b-9a2a-eedf31fb56b6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.758169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c504c12-4df0-4ec4-a1d2-c4cf232ab717 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.776856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:08.813477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694a0ee-919a-4d8b-9a2a-eedf31fb56b6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.819188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f07959-b1c0-4b39-8475-c35a479dbb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.820931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f07959-b1c0-4b39-8475-c35a479dbb84 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.821431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f07959-b1c0-4b39-8475-c35a479dbb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.821877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f07959-b1c0-4b39-8475-c35a479dbb84 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.823176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f07959-b1c0-4b39-8475-c35a479dbb84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.827680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f07959-b1c0-4b39-8475-c35a479dbb84 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.861501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1130/2230] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:08 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:29:08.865753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f07959-b1c0-4b39-8475-c35a479dbb84 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.882917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a60c4-4781-455b-9285-93631c5635b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.884442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a60c4-4781-455b-9285-93631c5635b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.886037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a60c4-4781-455b-9285-93631c5635b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.888748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a60c4-4781-455b-9285-93631c5635b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.892998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a60c4-4781-455b-9285-93631c5635b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.895693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f07959-b1c0-4b39-8475-c35a479dbb84 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.896100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a60c4-4781-455b-9285-93631c5635b1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.905658 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7717-e539-4764-8762-d0e7dbe16ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.906394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7717-e539-4764-8762-d0e7dbe16ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.908001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7717-e539-4764-8762-d0e7dbe16ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.908125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7717-e539-4764-8762-d0e7dbe16ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.908872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7717-e539-4764-8762-d0e7dbe16ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.910545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7717-e539-4764-8762-d0e7dbe16ff4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.930707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1131/2231] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:08 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:29:08.932175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7717-e539-4764-8762-d0e7dbe16ff4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.936654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1101/2232] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:08 2022] POST /identity/v3/users => generated 284 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:08.946908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a60c4-4781-455b-9285-93631c5635b1 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:08.960721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7717-e539-4764-8762-d0e7dbe16ff4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.963427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a60c4-4781-455b-9285-93631c5635b1 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:08.968768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056dda9-7657-4372-9a07-9ae57754a83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.969929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b02dcb-0bc7-495e-bdbd-b01aa89c4dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:08.970370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056dda9-7657-4372-9a07-9ae57754a83a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.970601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056dda9-7657-4372-9a07-9ae57754a83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.970721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b02dcb-0bc7-495e-bdbd-b01aa89c4dab admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:08.970931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056dda9-7657-4372-9a07-9ae57754a83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.971046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b02dcb-0bc7-495e-bdbd-b01aa89c4dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:08.971975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b02dcb-0bc7-495e-bdbd-b01aa89c4dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:08.972088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056dda9-7657-4372-9a07-9ae57754a83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.972167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b02dcb-0bc7-495e-bdbd-b01aa89c4dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:08.974007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b02dcb-0bc7-495e-bdbd-b01aa89c4dab admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.974138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056dda9-7657-4372-9a07-9ae57754a83a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:08.990359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1132/2233] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:08 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:08.995829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056dda9-7657-4372-9a07-9ae57754a83a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:09.001351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1102/2234] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:08 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:09.005814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b02dcb-0bc7-495e-bdbd-b01aa89c4dab admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:09.016612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056dda9-7657-4372-9a07-9ae57754a83a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:09.020970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b02dcb-0bc7-495e-bdbd-b01aa89c4dab admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:09.024299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614e1f2-9af5-49bb-99e3-2caf5f4a804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:09.025436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614e1f2-9af5-49bb-99e3-2caf5f4a804c admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.025879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614e1f2-9af5-49bb-99e3-2caf5f4a804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.026255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614e1f2-9af5-49bb-99e3-2caf5f4a804c admin admin] PATH_INFO: `/v3/projects/11159f096f0b4ba68579c7d26b5178b9/users/fd48b33d8d974d5eb0d53e5959bb4c42/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.027040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d1e80-af7b-4735-a582-dbb9ae3e1146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:09.027777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1e80-af7b-4735-a582-dbb9ae3e1146 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.028066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1e80-af7b-4735-a582-dbb9ae3e1146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.028432 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1e80-af7b-4735-a582-dbb9ae3e1146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.029252 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1e80-af7b-4735-a582-dbb9ae3e1146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:09.031019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1e80-af7b-4735-a582-dbb9ae3e1146 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:09.048570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1103/2235] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:09 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:09.050719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614e1f2-9af5-49bb-99e3-2caf5f4a804c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11159f096f0b4ba68579c7d26b5178b9, user_id=fd48b33d8d974d5eb0d53e5959bb4c42, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:09.053214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d1e80-af7b-4735-a582-dbb9ae3e1146 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:09.054740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614e1f2-9af5-49bb-99e3-2caf5f4a804c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:09.066426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d1e80-af7b-4735-a582-dbb9ae3e1146 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:09.076268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1133/2236] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:08 2022] PUT /identity/v3/projects/11159f096f0b4ba68579c7d26b5178b9/users/fd48b33d8d974d5eb0d53e5959bb4c42/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:09.082417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0da1-8dc1-43f3-a136-b5630be0b6e1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.082737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0da1-8dc1-43f3-a136-b5630be0b6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.082990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb0da1-8dc1-43f3-a136-b5630be0b6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.112865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4dfb0da1-8dc1-43f3-a136-b5630be0b6e1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:09.114496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4dfb0da1-8dc1-43f3-a136-b5630be0b6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:09.150355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:09.180947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3ee96-de7f-4450-a0c0-c25b39e2ddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:09.181960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ee96-de7f-4450-a0c0-c25b39e2ddfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.182226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ee96-de7f-4450-a0c0-c25b39e2ddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.182700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ee96-de7f-4450-a0c0-c25b39e2ddfd admin admin] PATH_INFO: `/v3/projects/b4794b4855cc46e9b346a6fabee7772a/users/f6fb94ccb43a4166ad6ae264eebea543/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.210518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3ee96-de7f-4450-a0c0-c25b39e2ddfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4794b4855cc46e9b346a6fabee7772a, user_id=f6fb94ccb43a4166ad6ae264eebea543, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:09.213751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3ee96-de7f-4450-a0c0-c25b39e2ddfd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:09.219101 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1134/2237] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:29:09.232045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0da1-8dc1-43f3-a136-b5630be0b6e1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:09.234860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4dfb0da1-8dc1-43f3-a136-b5630be0b6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:09.239523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1104/2238] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:09 2022] PUT /identity/v3/projects/b4794b4855cc46e9b346a6fabee7772a/users/f6fb94ccb43a4166ad6ae264eebea543/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:29:09.252725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949749-1113-451f-a94a-42b08ec59acf None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.253359 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949749-1113-451f-a94a-42b08ec59acf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.253745 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949749-1113-451f-a94a-42b08ec59acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.288807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a3949749-1113-451f-a94a-42b08ec59acf None None] MFA Rules not processed for user `f6fb94ccb43a4166ad6ae264eebea543`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:09.290388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a3949749-1113-451f-a94a-42b08ec59acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:09.314809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb0da1-8dc1-43f3-a136-b5630be0b6e1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:09.377159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:09.380346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008199f-b0b8-4a51-9dbf-9ed2b49ece7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:09.381129 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008199f-b0b8-4a51-9dbf-9ed2b49ece7c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.381511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008199f-b0b8-4a51-9dbf-9ed2b49ece7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.381882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008199f-b0b8-4a51-9dbf-9ed2b49ece7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.392313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1105/2239] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:29:09.397896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949749-1113-451f-a94a-42b08ec59acf None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:09.467582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008199f-b0b8-4a51-9dbf-9ed2b49ece7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:09.470721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008199f-b0b8-4a51-9dbf-9ed2b49ece7c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:09.486163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1135/2240] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:29:09.502021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949749-1113-451f-a94a-42b08ec59acf None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:09.510538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9fed5-e2b3-4074-bb03-50376c0c40ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:09.511938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9fed5-e2b3-4074-bb03-50376c0c40ac admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.512431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9fed5-e2b3-4074-bb03-50376c0c40ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.512716 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9fed5-e2b3-4074-bb03-50376c0c40ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.513439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9fed5-e2b3-4074-bb03-50376c0c40ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:09.516117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9fed5-e2b3-4074-bb03-50376c0c40ac admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:09.575595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1106/2241] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:09 2022] POST /identity/v3/projects => generated 366 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:29:09.577936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008199f-b0b8-4a51-9dbf-9ed2b49ece7c service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:09.590998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008199f-b0b8-4a51-9dbf-9ed2b49ece7c service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:09.647387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:09.703110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d028-5ad6-40ad-84c2-c01de349b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:09.704176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d028-5ad6-40ad-84c2-c01de349b7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.704716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d028-5ad6-40ad-84c2-c01de349b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.705145 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d028-5ad6-40ad-84c2-c01de349b7ec admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.706341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526d028-5ad6-40ad-84c2-c01de349b7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:09.708741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526d028-5ad6-40ad-84c2-c01de349b7ec admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:09.755024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1136/2242] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:09 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:09.758948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9fed5-e2b3-4074-bb03-50376c0c40ac admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:09.774033 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9fed5-e2b3-4074-bb03-50376c0c40ac admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:09.780641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457aa53-6c8a-4cd4-92ae-027ed989a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:09.781676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457aa53-6c8a-4cd4-92ae-027ed989a718 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.782690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457aa53-6c8a-4cd4-92ae-027ed989a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.783095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457aa53-6c8a-4cd4-92ae-027ed989a718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.784081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457aa53-6c8a-4cd4-92ae-027ed989a718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:09.786252 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457aa53-6c8a-4cd4-92ae-027ed989a718 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:09.811035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1107/2243] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:09 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:09.815981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d028-5ad6-40ad-84c2-c01de349b7ec admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:09.830376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d028-5ad6-40ad-84c2-c01de349b7ec admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:09.835863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b167-9888-402b-a810-824bb98a1a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:09.836874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b167-9888-402b-a810-824bb98a1a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:09.837234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b167-9888-402b-a810-824bb98a1a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:09.837585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b167-9888-402b-a810-824bb98a1a54 admin admin] PATH_INFO: `/v3/projects/354dda43908c44c2ae229e37419e417f/users/0505d29c9c03465abab7c14014b66307/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:09.861517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93b167-9888-402b-a810-824bb98a1a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354dda43908c44c2ae229e37419e417f, user_id=0505d29c9c03465abab7c14014b66307, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:09.865266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93b167-9888-402b-a810-824bb98a1a54 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:09.886304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1137/2244] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:09 2022] PUT /identity/v3/projects/354dda43908c44c2ae229e37419e417f/users/0505d29c9c03465abab7c14014b66307/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:29:09.889897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457aa53-6c8a-4cd4-92ae-027ed989a718 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:09.904881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457aa53-6c8a-4cd4-92ae-027ed989a718 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:10.000045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454640b5-2f59-4570-a1e8-c497b14b428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:10.001749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454640b5-2f59-4570-a1e8-c497b14b428e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:10.001951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454640b5-2f59-4570-a1e8-c497b14b428e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:10.002881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454640b5-2f59-4570-a1e8-c497b14b428e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:10.006870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454640b5-2f59-4570-a1e8-c497b14b428e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:10.009437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454640b5-2f59-4570-a1e8-c497b14b428e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:10.023388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1108/2245] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:09 2022] GET /identity/v3/roles => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:10.027881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b167-9888-402b-a810-824bb98a1a54 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:10.040894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b167-9888-402b-a810-824bb98a1a54 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:10.046305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ee93-32b0-4844-b9ca-1d3a4ad0ad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:10.047520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ee93-32b0-4844-b9ca-1d3a4ad0ad82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:10.047849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ee93-32b0-4844-b9ca-1d3a4ad0ad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:10.048133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ee93-32b0-4844-b9ca-1d3a4ad0ad82 admin admin] PATH_INFO: `/v3/projects/354dda43908c44c2ae229e37419e417f/users/0505d29c9c03465abab7c14014b66307/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:10.051035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ee93-32b0-4844-b9ca-1d3a4ad0ad82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354dda43908c44c2ae229e37419e417f, user_id=0505d29c9c03465abab7c14014b66307, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:10.056413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ee93-32b0-4844-b9ca-1d3a4ad0ad82 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:10.081283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284abc0-1bdd-4f24-8c3f-46a9cf4ffec5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:10.081596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284abc0-1bdd-4f24-8c3f-46a9cf4ffec5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:10.081862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284abc0-1bdd-4f24-8c3f-46a9cf4ffec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:10.084121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1138/2246] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:10 2022] PUT /identity/v3/projects/354dda43908c44c2ae229e37419e417f/users/0505d29c9c03465abab7c14014b66307/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:10.116291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f284abc0-1bdd-4f24-8c3f-46a9cf4ffec5 None None] MFA Rules not processed for user `0505d29c9c03465abab7c14014b66307`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:10.117601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f284abc0-1bdd-4f24-8c3f-46a9cf4ffec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:10.200962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:10.225428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1109/2247] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:10.238395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ee93-32b0-4844-b9ca-1d3a4ad0ad82 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:10.241204 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ed48ee93-32b0-4844-b9ca-1d3a4ad0ad82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:10.327081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ee93-32b0-4844-b9ca-1d3a4ad0ad82 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:10.331198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cc902-c38c-4259-8db2-3570e6d584d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:10.331899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc902-c38c-4259-8db2-3570e6d584d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:10.332237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc902-c38c-4259-8db2-3570e6d584d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:10.332527 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc902-c38c-4259-8db2-3570e6d584d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:10.343986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cc902-c38c-4259-8db2-3570e6d584d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:10.346046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cc902-c38c-4259-8db2-3570e6d584d0 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:10.359265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1139/2248] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:11.135829 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284abc0-1bdd-4f24-8c3f-46a9cf4ffec5 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:11.273506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284abc0-1bdd-4f24-8c3f-46a9cf4ffec5 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:11.283395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:11.284569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:11.284958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:11.285336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] PATH_INFO: `/v3/users/f6fb94ccb43a4166ad6ae264eebea543` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:11.286893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6fb94ccb43a4166ad6ae264eebea543)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:11.289740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:11.373878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6fb94ccb43a4166ad6ae264eebea543'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:11.374743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6fb94ccb43a4166ad6ae264eebea543'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:11.403674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6fb94ccb43a4166ad6ae264eebea543'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:11.421478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6fb94ccb43a4166ad6ae264eebea543'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:11.422527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6fb94ccb43a4166ad6ae264eebea543'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:11.451728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1110/2249] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:11 2022] DELETE /identity/v3/users/f6fb94ccb43a4166ad6ae264eebea543 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:11.457821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e0765-36d3-4f1b-8705-b76a9d4e490b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:11.463991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e0765-36d3-4f1b-8705-b76a9d4e490b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:11.464547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e0765-36d3-4f1b-8705-b76a9d4e490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:11.485192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0e3e0765-36d3-4f1b-8705-b76a9d4e490b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:11.486836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0e3e0765-36d3-4f1b-8705-b76a9d4e490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:11.592592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1140/2250] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:29:11.594203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:11.596842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:11.771590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d674f78-5c92-4f0b-9d40-8d794fa8401a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:11.771590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a12bc8-67a8-41de-81de-c0660ebc6d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:11.771590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a12bc8-67a8-41de-81de-c0660ebc6d59 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:11.771590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a12bc8-67a8-41de-81de-c0660ebc6d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:11.772107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a12bc8-67a8-41de-81de-c0660ebc6d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:11.815641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a12bc8-67a8-41de-81de-c0660ebc6d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:11.817363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a12bc8-67a8-41de-81de-c0660ebc6d59 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:11.838250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1111/2251] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:12.856019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e0765-36d3-4f1b-8705-b76a9d4e490b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:12.858526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0e3e0765-36d3-4f1b-8705-b76a9d4e490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:12.882232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e0765-36d3-4f1b-8705-b76a9d4e490b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:12.894125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:12.895029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:12.895478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:12.895641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] PATH_INFO: `/v3/projects/b4794b4855cc46e9b346a6fabee7772a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:12.904407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4794b4855cc46e9b346a6fabee7772a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:12.906962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:12.992206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:13.066809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4794b4855cc46e9b346a6fabee7772a', 'request_id': 'req-e1fe20ad-9690-4695-83a3-e214fad04ecc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.078125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4794b4855cc46e9b346a6fabee7772a', 'request_id': 'req-e1fe20ad-9690-4695-83a3-e214fad04ecc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.115841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4794b4855cc46e9b346a6fabee7772a', 'request_id': 'req-e1fe20ad-9690-4695-83a3-e214fad04ecc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.137863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] The token cache is being invalidate because project b4794b4855cc46e9b346a6fabee7772a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:13.138770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.140108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.142108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1141/2252] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:12 2022] DELETE /identity/v3/projects/b4794b4855cc46e9b346a6fabee7772a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:13.146789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a12bc8-67a8-41de-81de-c0660ebc6d59 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:13.171022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a12bc8-67a8-41de-81de-c0660ebc6d59 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:13.186241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:13.296939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:13.298084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:13.304058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:13.305812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] PATH_INFO: `/v3/users/0505d29c9c03465abab7c14014b66307` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:13.307355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0505d29c9c03465abab7c14014b66307)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:13.309445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:13.416659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0505d29c9c03465abab7c14014b66307'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.418719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0505d29c9c03465abab7c14014b66307'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.442084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0505d29c9c03465abab7c14014b66307'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.466290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0505d29c9c03465abab7c14014b66307'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.468221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9b4c525a-31bb-4f7e-968a-aeb598009f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0505d29c9c03465abab7c14014b66307'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:13.492864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1112/2253] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:13 2022] DELETE /identity/v3/users/0505d29c9c03465abab7c14014b66307 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:14.106232 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:14.107811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:14.154024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe20ad-9690-4695-83a3-e214fad04ecc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:14.268794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:14.270093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:14.270693 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:14.271140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] PATH_INFO: `/v3/projects/354dda43908c44c2ae229e37419e417f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:14.272606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=354dda43908c44c2ae229e37419e417f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:14.275059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:14.395078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354dda43908c44c2ae229e37419e417f', 'request_id': 'req-046c1df9-edcb-4086-a4ef-5834505afcaf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:14.412754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354dda43908c44c2ae229e37419e417f', 'request_id': 'req-046c1df9-edcb-4086-a4ef-5834505afcaf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:14.427973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354dda43908c44c2ae229e37419e417f', 'request_id': 'req-046c1df9-edcb-4086-a4ef-5834505afcaf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:14.449138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] The token cache is being invalidate because project 354dda43908c44c2ae229e37419e417f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:14.449295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:14.450010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-046c1df9-edcb-4086-a4ef-5834505afcaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:14.452389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1142/2254] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:14 2022] DELETE /identity/v3/projects/354dda43908c44c2ae229e37419e417f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:14.457244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd999d-ceea-4bf0-ab14-f50337ebee45 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:14.458121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd999d-ceea-4bf0-ab14-f50337ebee45 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:14.458402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd999d-ceea-4bf0-ab14-f50337ebee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:14.481695 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1dfd999d-ceea-4bf0-ab14-f50337ebee45 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:14.483381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1dfd999d-ceea-4bf0-ab14-f50337ebee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:14.579749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1113/2255] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:14.589830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99976f-4838-45fe-b2b0-e4d2d7aaa733 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:14.590178 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99976f-4838-45fe-b2b0-e4d2d7aaa733 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:14.590431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99976f-4838-45fe-b2b0-e4d2d7aaa733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:14.630743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6b99976f-4838-45fe-b2b0-e4d2d7aaa733 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:14.632014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6b99976f-4838-45fe-b2b0-e4d2d7aaa733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:14.660355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd999d-ceea-4bf0-ab14-f50337ebee45 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:14.664375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1143/2256] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:14.675294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd999d-ceea-4bf0-ab14-f50337ebee45 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:14.689492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb04906-4a8b-4952-951d-b371ec651380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:14.690686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb04906-4a8b-4952-951d-b371ec651380 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:14.691348 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb04906-4a8b-4952-951d-b371ec651380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:14.691866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb04906-4a8b-4952-951d-b371ec651380 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:14.692831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb04906-4a8b-4952-951d-b371ec651380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:29:14.693370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb04906-4a8b-4952-951d-b371ec651380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:14.699283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb04906-4a8b-4952-951d-b371ec651380 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:14.726932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1114/2257] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:29:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:29:14.728984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99976f-4838-45fe-b2b0-e4d2d7aaa733 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:14.744262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99976f-4838-45fe-b2b0-e4d2d7aaa733 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:14.760099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9ffad-2bd8-4503-ac61-bb56fdfd6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:14.761618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9ffad-2bd8-4503-ac61-bb56fdfd6bda admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:14.762451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9ffad-2bd8-4503-ac61-bb56fdfd6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:14.763074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9ffad-2bd8-4503-ac61-bb56fdfd6bda admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:14.764337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9ffad-2bd8-4503-ac61-bb56fdfd6bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:14.766638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9ffad-2bd8-4503-ac61-bb56fdfd6bda admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:14.858089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1144/2258] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:14 2022] POST /identity/v3/projects => generated 386 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:14.863339 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb04906-4a8b-4952-951d-b371ec651380 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:14.877744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb04906-4a8b-4952-951d-b371ec651380 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:14.922475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:15.036712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69244db1-0443-45d7-b821-e29a83855fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:15.038881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69244db1-0443-45d7-b821-e29a83855fca admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:15.042442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69244db1-0443-45d7-b821-e29a83855fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:15.042590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69244db1-0443-45d7-b821-e29a83855fca admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:15.045520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69244db1-0443-45d7-b821-e29a83855fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:15.052400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69244db1-0443-45d7-b821-e29a83855fca admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:15.113685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1115/2259] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:14 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:15.117114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9ffad-2bd8-4503-ac61-bb56fdfd6bda admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:15.135829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9ffad-2bd8-4503-ac61-bb56fdfd6bda admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:15.176402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a2fdd-034f-48f5-a3f0-13d05f0f6064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:15.181306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a2fdd-034f-48f5-a3f0-13d05f0f6064 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:15.181983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a2fdd-034f-48f5-a3f0-13d05f0f6064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:15.182447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a2fdd-034f-48f5-a3f0-13d05f0f6064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:15.183767 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a2fdd-034f-48f5-a3f0-13d05f0f6064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:15.191527 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a2fdd-034f-48f5-a3f0-13d05f0f6064 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:15.217375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:15.233620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69244db1-0443-45d7-b821-e29a83855fca admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:15.233967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1145/2260] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:15 2022] GET /identity/v3/roles => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:15.256592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69244db1-0443-45d7-b821-e29a83855fca admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:15.279238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f56e-79e1-45df-a6f6-86ece5e7c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:15.279976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f56e-79e1-45df-a6f6-86ece5e7c75e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:15.284847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f56e-79e1-45df-a6f6-86ece5e7c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:15.285770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f56e-79e1-45df-a6f6-86ece5e7c75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:15.294739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09f56e-79e1-45df-a6f6-86ece5e7c75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:15.294739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09f56e-79e1-45df-a6f6-86ece5e7c75e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:15.346700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1116/2261] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:15 2022] GET /identity/v3/roles => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:29:15.348496 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a2fdd-034f-48f5-a3f0-13d05f0f6064 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:15.363408 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a2fdd-034f-48f5-a3f0-13d05f0f6064 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:15.378318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd8d0-5109-4b7c-8424-fba61d631194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:15.379577 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd8d0-5109-4b7c-8424-fba61d631194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:15.380158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd8d0-5109-4b7c-8424-fba61d631194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:15.380665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd8d0-5109-4b7c-8424-fba61d631194 admin admin] PATH_INFO: `/v3/projects/849b6d96f633425db47dd3bc344d628f/users/fe843acd504b41f9b76eadc4f329967d/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:15.426242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fd8d0-5109-4b7c-8424-fba61d631194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849b6d96f633425db47dd3bc344d628f, user_id=fe843acd504b41f9b76eadc4f329967d, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:15.429766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fd8d0-5109-4b7c-8424-fba61d631194 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:15.450364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1146/2262] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:15 2022] PUT /identity/v3/projects/849b6d96f633425db47dd3bc344d628f/users/fe843acd504b41f9b76eadc4f329967d/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:15.461174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af1f92-2a52-4e55-a2bc-4237f9c185e1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:15.461663 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af1f92-2a52-4e55-a2bc-4237f9c185e1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:15.462356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af1f92-2a52-4e55-a2bc-4237f9c185e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:15.532825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c0af1f92-2a52-4e55-a2bc-4237f9c185e1 None None] MFA Rules not processed for user `fe843acd504b41f9b76eadc4f329967d`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:15.534178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c0af1f92-2a52-4e55-a2bc-4237f9c185e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:15.691327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1117/2263] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:15.695593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd8d0-5109-4b7c-8424-fba61d631194 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:15.827339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd8d0-5109-4b7c-8424-fba61d631194 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:15.832745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8065f-7940-4a6e-8c4d-452a138a2c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:15.833398 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8065f-7940-4a6e-8c4d-452a138a2c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:15.833689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8065f-7940-4a6e-8c4d-452a138a2c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:15.834019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8065f-7940-4a6e-8c4d-452a138a2c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:15.835198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8065f-7940-4a6e-8c4d-452a138a2c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:15.836806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8065f-7940-4a6e-8c4d-452a138a2c48 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:15.878209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1147/2264] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:15 2022] POST /identity/v3/projects => generated 388 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:29:15.882243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af1f92-2a52-4e55-a2bc-4237f9c185e1 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:15.899440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af1f92-2a52-4e55-a2bc-4237f9c185e1 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:16.011779 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf00055-a79b-4ec5-af33-fe75bc77eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:16.013395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf00055-a79b-4ec5-af33-fe75bc77eb4f admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:16.013850 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf00055-a79b-4ec5-af33-fe75bc77eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:16.014582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf00055-a79b-4ec5-af33-fe75bc77eb4f admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:16.017547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf00055-a79b-4ec5-af33-fe75bc77eb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:16.023990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf00055-a79b-4ec5-af33-fe75bc77eb4f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:16.054927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1118/2265] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:15 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:16.059330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8065f-7940-4a6e-8c4d-452a138a2c48 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:16.085071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8065f-7940-4a6e-8c4d-452a138a2c48 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:16.093766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab75b5-dea8-4b93-9337-9158a978633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:16.093766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab75b5-dea8-4b93-9337-9158a978633c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:16.093766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab75b5-dea8-4b93-9337-9158a978633c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:16.093766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab75b5-dea8-4b93-9337-9158a978633c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:16.094332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab75b5-dea8-4b93-9337-9158a978633c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:16.096438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab75b5-dea8-4b93-9337-9158a978633c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:16.131741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1148/2266] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:16 2022] GET /identity/v3/roles => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:16.135981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf00055-a79b-4ec5-af33-fe75bc77eb4f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:16.169363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf00055-a79b-4ec5-af33-fe75bc77eb4f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:16.181655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcb177-59ba-4b41-ab2f-544756bc47cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:16.182596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcb177-59ba-4b41-ab2f-544756bc47cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:16.182877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcb177-59ba-4b41-ab2f-544756bc47cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:16.183155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcb177-59ba-4b41-ab2f-544756bc47cd admin admin] PATH_INFO: `/v3/projects/430015349d6a4a9f9f61674f22c843b0/users/7dee737089ca47f483e2e16fafdd0691/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:16.221693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:16.240610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcb177-59ba-4b41-ab2f-544756bc47cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=430015349d6a4a9f9f61674f22c843b0, user_id=7dee737089ca47f483e2e16fafdd0691, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:16.243824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcb177-59ba-4b41-ab2f-544756bc47cd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:16.270749 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1119/2267] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:16 2022] PUT /identity/v3/projects/430015349d6a4a9f9f61674f22c843b0/users/7dee737089ca47f483e2e16fafdd0691/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:16.272522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab75b5-dea8-4b93-9337-9158a978633c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:16.286236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab75b5-dea8-4b93-9337-9158a978633c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:16.427306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603db83f-58a3-44ca-9b1c-fc527539eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:16.434401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db83f-58a3-44ca-9b1c-fc527539eb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:16.434791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db83f-58a3-44ca-9b1c-fc527539eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:16.435144 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db83f-58a3-44ca-9b1c-fc527539eb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:16.436730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603db83f-58a3-44ca-9b1c-fc527539eb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:16.439181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603db83f-58a3-44ca-9b1c-fc527539eb6b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:16.465118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcb177-59ba-4b41-ab2f-544756bc47cd admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:16.465994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1149/2268] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:16 2022] GET /identity/v3/roles => generated 1427 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:16.486402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcb177-59ba-4b41-ab2f-544756bc47cd admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:16.509922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572651c-3d30-46c7-ae58-184a806c75d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:16.510937 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572651c-3d30-46c7-ae58-184a806c75d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:16.511327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572651c-3d30-46c7-ae58-184a806c75d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:16.511634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572651c-3d30-46c7-ae58-184a806c75d2 admin admin] PATH_INFO: `/v3/projects/430015349d6a4a9f9f61674f22c843b0/users/7dee737089ca47f483e2e16fafdd0691/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:16.546112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572651c-3d30-46c7-ae58-184a806c75d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430015349d6a4a9f9f61674f22c843b0, user_id=7dee737089ca47f483e2e16fafdd0691, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:16.561792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572651c-3d30-46c7-ae58-184a806c75d2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:16.614766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1120/2269] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:16 2022] PUT /identity/v3/projects/430015349d6a4a9f9f61674f22c843b0/users/7dee737089ca47f483e2e16fafdd0691/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:16.627782 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf06e-f041-465c-bb32-c43a9b78de8d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:16.628471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf06e-f041-465c-bb32-c43a9b78de8d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:16.629110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf06e-f041-465c-bb32-c43a9b78de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:16.708428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-00daf06e-f041-465c-bb32-c43a9b78de8d None None] MFA Rules not processed for user `7dee737089ca47f483e2e16fafdd0691`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:16.716057 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-00daf06e-f041-465c-bb32-c43a9b78de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:16.822650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:16.902074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1150/2270] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:16.949019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572651c-3d30-46c7-ae58-184a806c75d2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:16.951202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6572651c-3d30-46c7-ae58-184a806c75d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:16.977245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8336-d54c-4275-b667-d5d92a001061 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:16.977939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8336-d54c-4275-b667-d5d92a001061 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:16.978430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8336-d54c-4275-b667-d5d92a001061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:17.058302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d05b8336-d54c-4275-b667-d5d92a001061 None None] MFA Rules not processed for user `fd48b33d8d974d5eb0d53e5959bb4c42`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:17.063272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d05b8336-d54c-4275-b667-d5d92a001061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:17.169655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572651c-3d30-46c7-ae58-184a806c75d2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:17.181654 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b09927-8707-4ccd-89a3-ef8590144406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:17.182330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b09927-8707-4ccd-89a3-ef8590144406 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:17.182616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b09927-8707-4ccd-89a3-ef8590144406 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:17.183077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b09927-8707-4ccd-89a3-ef8590144406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:17.215460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b09927-8707-4ccd-89a3-ef8590144406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:17.217615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b09927-8707-4ccd-89a3-ef8590144406 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:17.258050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1121/2271] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:17.384916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b09927-8707-4ccd-89a3-ef8590144406 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:17.410444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1151/2272] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:29:17.419413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8336-d54c-4275-b667-d5d92a001061 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:17.433580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d05b8336-d54c-4275-b667-d5d92a001061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:17.647809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b09927-8707-4ccd-89a3-ef8590144406 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:17.661896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:17.662867 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:17.663156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:17.671233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] PATH_INFO: `/v3/users/fe843acd504b41f9b76eadc4f329967d` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:17.675453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe843acd504b41f9b76eadc4f329967d)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:17.682349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:17.695916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8336-d54c-4275-b667-d5d92a001061 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:17.717108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208f013-19a8-42ae-bdb1-99cdf54ca420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:17.718118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f013-19a8-42ae-bdb1-99cdf54ca420 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:17.718409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f013-19a8-42ae-bdb1-99cdf54ca420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:17.718857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208f013-19a8-42ae-bdb1-99cdf54ca420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:17.719463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208f013-19a8-42ae-bdb1-99cdf54ca420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:17.727543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208f013-19a8-42ae-bdb1-99cdf54ca420 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:17.783390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1152/2273] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:17 2022] POST /identity/v3/projects => generated 372 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:17.788023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208f013-19a8-42ae-bdb1-99cdf54ca420 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:17.801101 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe843acd504b41f9b76eadc4f329967d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:17.801948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe843acd504b41f9b76eadc4f329967d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:17.835803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe843acd504b41f9b76eadc4f329967d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:17.855369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe843acd504b41f9b76eadc4f329967d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:17.856620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-197480ab-8b37-48db-9d0d-64572866dc65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe843acd504b41f9b76eadc4f329967d'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:17.878102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:17.886438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:17.891734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1122/2274] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:17 2022] DELETE /identity/v3/users/fe843acd504b41f9b76eadc4f329967d => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:17.900689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1134b42-4478-4e77-bc9c-2fc1d2615e78 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:17.907476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1134b42-4478-4e77-bc9c-2fc1d2615e78 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:17.908737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1134b42-4478-4e77-bc9c-2fc1d2615e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:17.994215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c1134b42-4478-4e77-bc9c-2fc1d2615e78 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:17.995586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c1134b42-4478-4e77-bc9c-2fc1d2615e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:18.104290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208f013-19a8-42ae-bdb1-99cdf54ca420 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:18.121917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1123/2275] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:18.135686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1134b42-4478-4e77-bc9c-2fc1d2615e78 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:18.140992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c1134b42-4478-4e77-bc9c-2fc1d2615e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:18.269366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea0c1-371b-451a-9c86-aeea144b1538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:18.270192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea0c1-371b-451a-9c86-aeea144b1538 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:18.278386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea0c1-371b-451a-9c86-aeea144b1538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:18.279076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea0c1-371b-451a-9c86-aeea144b1538 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:18.283169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dea0c1-371b-451a-9c86-aeea144b1538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:18.288357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dea0c1-371b-451a-9c86-aeea144b1538 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:18.319640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1153/2276] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:17 2022] POST /identity/v3/users => generated 293 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:18.325268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea0c1-371b-451a-9c86-aeea144b1538 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:18.329690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-23dea0c1-371b-451a-9c86-aeea144b1538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:18.346092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea0c1-371b-451a-9c86-aeea144b1538 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:18.354073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab129488-2cb5-473f-83c0-fe820b75fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:18.355348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab129488-2cb5-473f-83c0-fe820b75fc18 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:18.355813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab129488-2cb5-473f-83c0-fe820b75fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:18.356251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab129488-2cb5-473f-83c0-fe820b75fc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:18.357170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab129488-2cb5-473f-83c0-fe820b75fc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:18.358727 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1134b42-4478-4e77-bc9c-2fc1d2615e78 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:18.359918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab129488-2cb5-473f-83c0-fe820b75fc18 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:18.364340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f6dbc-2479-4aa0-8d84-a11b8db9aaec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:18.365036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f6dbc-2479-4aa0-8d84-a11b8db9aaec service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:18.365316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f6dbc-2479-4aa0-8d84-a11b8db9aaec service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:18.365593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f6dbc-2479-4aa0-8d84-a11b8db9aaec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:18.372889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1154/2277] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:18 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:29:18.376920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab129488-2cb5-473f-83c0-fe820b75fc18 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:18.379526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f6dbc-2479-4aa0-8d84-a11b8db9aaec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:18.381139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f6dbc-2479-4aa0-8d84-a11b8db9aaec service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:18.390234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab129488-2cb5-473f-83c0-fe820b75fc18 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:18.394320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1124/2278] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:18.397935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07588ca3-468b-4f57-bf28-e40fdf86bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:18.399130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07588ca3-468b-4f57-bf28-e40fdf86bcc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:18.399628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07588ca3-468b-4f57-bf28-e40fdf86bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:18.400099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07588ca3-468b-4f57-bf28-e40fdf86bcc9 admin admin] PATH_INFO: `/v3/projects/8a53007ee0b84a2f921f0543bdd78b41/users/6a5af25e4340491bb3535c2f38226212/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:18.425167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07588ca3-468b-4f57-bf28-e40fdf86bcc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a53007ee0b84a2f921f0543bdd78b41, user_id=6a5af25e4340491bb3535c2f38226212, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:18.430299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07588ca3-468b-4f57-bf28-e40fdf86bcc9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:18.450986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1155/2279] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:18 2022] PUT /identity/v3/projects/8a53007ee0b84a2f921f0543bdd78b41/users/6a5af25e4340491bb3535c2f38226212/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:18.456138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f6dbc-2479-4aa0-8d84-a11b8db9aaec service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:18.474374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f6dbc-2479-4aa0-8d84-a11b8db9aaec service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:18.551207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:18.648475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a596-1372-4f93-ae62-0b8468e14712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:18.649539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a596-1372-4f93-ae62-0b8468e14712 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:18.649834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a596-1372-4f93-ae62-0b8468e14712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:18.650139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a596-1372-4f93-ae62-0b8468e14712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:18.659891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a596-1372-4f93-ae62-0b8468e14712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:18.668838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a596-1372-4f93-ae62-0b8468e14712 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:18.696314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1125/2280] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:18 2022] GET /identity/v3/roles => generated 1427 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:18.700452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07588ca3-468b-4f57-bf28-e40fdf86bcc9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:18.770781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07588ca3-468b-4f57-bf28-e40fdf86bcc9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:18.802800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa370e-a792-463b-af41-ac38e80054b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:18.811899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa370e-a792-463b-af41-ac38e80054b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:18.818091 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa370e-a792-463b-af41-ac38e80054b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:18.818592 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa370e-a792-463b-af41-ac38e80054b1 admin admin] PATH_INFO: `/v3/projects/8a53007ee0b84a2f921f0543bdd78b41/users/6a5af25e4340491bb3535c2f38226212/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:18.825969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa370e-a792-463b-af41-ac38e80054b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a53007ee0b84a2f921f0543bdd78b41, user_id=6a5af25e4340491bb3535c2f38226212, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:18.833238 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa370e-a792-463b-af41-ac38e80054b1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:18.887597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1156/2281] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:18 2022] PUT /identity/v3/projects/8a53007ee0b84a2f921f0543bdd78b41/users/6a5af25e4340491bb3535c2f38226212/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:19.301924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a596-1372-4f93-ae62-0b8468e14712 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:19.304520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-31e3a596-1372-4f93-ae62-0b8468e14712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:19.328851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a596-1372-4f93-ae62-0b8468e14712 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:19.499199 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:19.500351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:19.500644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:19.500939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] PATH_INFO: `/v3/projects/849b6d96f633425db47dd3bc344d628f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:19.515289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] RBAC: Authorizing `identity:delete_project(project_id=849b6d96f633425db47dd3bc344d628f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:19.524300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:19.654074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849b6d96f633425db47dd3bc344d628f', 'request_id': 'req-f7aed528-17ab-4945-8d45-45f83d0d172a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:19.665758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849b6d96f633425db47dd3bc344d628f', 'request_id': 'req-f7aed528-17ab-4945-8d45-45f83d0d172a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:19.677567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849b6d96f633425db47dd3bc344d628f', 'request_id': 'req-f7aed528-17ab-4945-8d45-45f83d0d172a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:19.715407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] The token cache is being invalidate because project 849b6d96f633425db47dd3bc344d628f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:19.716342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:19.717452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:19.720551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1126/2282] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:19 2022] DELETE /identity/v3/projects/849b6d96f633425db47dd3bc344d628f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:19.724393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa370e-a792-463b-af41-ac38e80054b1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:19.726260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e2aa370e-a792-463b-af41-ac38e80054b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:19.761673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa370e-a792-463b-af41-ac38e80054b1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:19.930176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:19.956215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:19.957776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:19.958172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:19.958571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] PATH_INFO: `/v3/users/7dee737089ca47f483e2e16fafdd0691` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:19.961084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dee737089ca47f483e2e16fafdd0691)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:19.966752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:20.090638 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dee737089ca47f483e2e16fafdd0691'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:20.092133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dee737089ca47f483e2e16fafdd0691'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:20.128897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dee737089ca47f483e2e16fafdd0691'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:20.132884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dee737089ca47f483e2e16fafdd0691'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:20.154441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-455395eb-76be-49ff-b5a7-da51c0706917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dee737089ca47f483e2e16fafdd0691'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:20.214880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1157/2283] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:19 2022] DELETE /identity/v3/users/7dee737089ca47f483e2e16fafdd0691 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:20.780753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:20.814462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed528-17ab-4945-8d45-45f83d0d172a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:21.127222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:21.128625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:21.129365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:21.129972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] PATH_INFO: `/v3/projects/430015349d6a4a9f9f61674f22c843b0` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:21.133684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430015349d6a4a9f9f61674f22c843b0)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:21.136571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:21.149531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:21.320400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430015349d6a4a9f9f61674f22c843b0', 'request_id': 'req-3eae62ca-da80-4349-8386-4c13eb5e7d68'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:21.345130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430015349d6a4a9f9f61674f22c843b0', 'request_id': 'req-3eae62ca-da80-4349-8386-4c13eb5e7d68'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:21.371248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430015349d6a4a9f9f61674f22c843b0', 'request_id': 'req-3eae62ca-da80-4349-8386-4c13eb5e7d68'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:21.409244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] The token cache is being invalidate because project 430015349d6a4a9f9f61674f22c843b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:21.412383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:21.415507 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-3eae62ca-da80-4349-8386-4c13eb5e7d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:21.420982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1127/2284] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:20 2022] DELETE /identity/v3/projects/430015349d6a4a9f9f61674f22c843b0 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:21.426631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6624d7-7d0c-4e63-a100-b1ff45351081 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:21.427713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6624d7-7d0c-4e63-a100-b1ff45351081 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:21.428097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6624d7-7d0c-4e63-a100-b1ff45351081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:21.542296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0b6624d7-7d0c-4e63-a100-b1ff45351081 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:21.544161 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0b6624d7-7d0c-4e63-a100-b1ff45351081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:21.653407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1158/2285] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:21.662448 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fab07-a12d-4479-b680-d295fc7fcceb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:21.663282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fab07-a12d-4479-b680-d295fc7fcceb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:21.663798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fab07-a12d-4479-b680-d295fc7fcceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:21.697923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-168fab07-a12d-4479-b680-d295fc7fcceb None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:21.699344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-168fab07-a12d-4479-b680-d295fc7fcceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:21.709649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1128/2286] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:21.714272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6624d7-7d0c-4e63-a100-b1ff45351081 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:21.742174 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6624d7-7d0c-4e63-a100-b1ff45351081 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:21.755539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f97d3-9031-439f-9e1a-c5f0ac079d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:21.756350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f97d3-9031-439f-9e1a-c5f0ac079d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:21.756637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f97d3-9031-439f-9e1a-c5f0ac079d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:21.756912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f97d3-9031-439f-9e1a-c5f0ac079d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:21.757786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f97d3-9031-439f-9e1a-c5f0ac079d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:29:21.758106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f97d3-9031-439f-9e1a-c5f0ac079d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:21.759824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f97d3-9031-439f-9e1a-c5f0ac079d53 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:21.791983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1159/2287] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:29:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:29:21.792227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fab07-a12d-4479-b680-d295fc7fcceb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:21.804637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fab07-a12d-4479-b680-d295fc7fcceb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:21.831918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5446a-3460-4560-b956-98a9e1855fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:21.836519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5446a-3460-4560-b956-98a9e1855fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:21.837600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5446a-3460-4560-b956-98a9e1855fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:21.838074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5446a-3460-4560-b956-98a9e1855fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:21.841375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5446a-3460-4560-b956-98a9e1855fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:21.855095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5446a-3460-4560-b956-98a9e1855fc8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:21.936712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f97d3-9031-439f-9e1a-c5f0ac079d53 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:21.937930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1129/2288] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:21 2022] POST /identity/v3/projects => generated 382 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:21.953459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f97d3-9031-439f-9e1a-c5f0ac079d53 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:22.083278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:22.117624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c27ff-9fd3-4ef1-a36f-f0fd884b8638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:22.118931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c27ff-9fd3-4ef1-a36f-f0fd884b8638 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:22.118931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c27ff-9fd3-4ef1-a36f-f0fd884b8638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:22.119370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c27ff-9fd3-4ef1-a36f-f0fd884b8638 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:22.122444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c27ff-9fd3-4ef1-a36f-f0fd884b8638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:22.125663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c27ff-9fd3-4ef1-a36f-f0fd884b8638 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:22.177557 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5446a-3460-4560-b956-98a9e1855fc8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:22.178755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1160/2289] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:21 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:22.199085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5446a-3460-4560-b956-98a9e1855fc8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:22.242011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f13d86-2ea0-4a78-a21e-cb1f8b9e6d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:22.245208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f13d86-2ea0-4a78-a21e-cb1f8b9e6d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:22.245736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f13d86-2ea0-4a78-a21e-cb1f8b9e6d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:22.247909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f13d86-2ea0-4a78-a21e-cb1f8b9e6d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:22.254274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f13d86-2ea0-4a78-a21e-cb1f8b9e6d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:22.264185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f13d86-2ea0-4a78-a21e-cb1f8b9e6d79 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:22.311193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c27ff-9fd3-4ef1-a36f-f0fd884b8638 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:22.324186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1130/2290] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:22 2022] GET /identity/v3/roles => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:22.333221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c27ff-9fd3-4ef1-a36f-f0fd884b8638 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:22.353680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceae12-945a-40fa-b83c-9be0eb8e3b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:22.354402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceae12-945a-40fa-b83c-9be0eb8e3b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:22.354728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceae12-945a-40fa-b83c-9be0eb8e3b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:22.355322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceae12-945a-40fa-b83c-9be0eb8e3b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:22.356327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceae12-945a-40fa-b83c-9be0eb8e3b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:22.358653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceae12-945a-40fa-b83c-9be0eb8e3b6b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:22.411762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1161/2291] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:22 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:22.416572 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f13d86-2ea0-4a78-a21e-cb1f8b9e6d79 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:22.433844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f13d86-2ea0-4a78-a21e-cb1f8b9e6d79 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:22.449586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd2f6b-d28e-4501-9f43-fe5546214820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:22.452181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd2f6b-d28e-4501-9f43-fe5546214820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:22.453663 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd2f6b-d28e-4501-9f43-fe5546214820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:22.455429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd2f6b-d28e-4501-9f43-fe5546214820 admin admin] PATH_INFO: `/v3/projects/f5d5be3f28744acfb82a6d537f817398/users/7fd1fc0d1dc7437a814fcadb78520ac4/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:22.520094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd2f6b-d28e-4501-9f43-fe5546214820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d5be3f28744acfb82a6d537f817398, user_id=7fd1fc0d1dc7437a814fcadb78520ac4, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:22.539474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd2f6b-d28e-4501-9f43-fe5546214820 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:22.595106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1131/2292] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:22 2022] PUT /identity/v3/projects/f5d5be3f28744acfb82a6d537f817398/users/7fd1fc0d1dc7437a814fcadb78520ac4/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:22.607178 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28562d20-da21-4180-af65-368a21ae151f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:22.607766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28562d20-da21-4180-af65-368a21ae151f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:22.608178 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28562d20-da21-4180-af65-368a21ae151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:22.728516 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-28562d20-da21-4180-af65-368a21ae151f None None] MFA Rules not processed for user `7fd1fc0d1dc7437a814fcadb78520ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:22.736464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-28562d20-da21-4180-af65-368a21ae151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:22.971933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1162/2293] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:22.976508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd2f6b-d28e-4501-9f43-fe5546214820 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:23.126524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd2f6b-d28e-4501-9f43-fe5546214820 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:23.152399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a466ee-1950-4bbe-89f4-4da0639836b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:23.153534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a466ee-1950-4bbe-89f4-4da0639836b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:23.154316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a466ee-1950-4bbe-89f4-4da0639836b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:23.154906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a466ee-1950-4bbe-89f4-4da0639836b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:23.165960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a466ee-1950-4bbe-89f4-4da0639836b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:23.169376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a466ee-1950-4bbe-89f4-4da0639836b6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:23.251234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1132/2294] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:22 2022] POST /identity/v3/projects => generated 382 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:23.255209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28562d20-da21-4180-af65-368a21ae151f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:23.273069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28562d20-da21-4180-af65-368a21ae151f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:23.409838 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8cf70-78bb-4ddb-a6c8-71c087d6c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:23.411000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8cf70-78bb-4ddb-a6c8-71c087d6c1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:23.411387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8cf70-78bb-4ddb-a6c8-71c087d6c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:23.411811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8cf70-78bb-4ddb-a6c8-71c087d6c1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:23.413589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8cf70-78bb-4ddb-a6c8-71c087d6c1f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:23.416459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8cf70-78bb-4ddb-a6c8-71c087d6c1f4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:23.452880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1163/2295] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:23 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:23.456739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a466ee-1950-4bbe-89f4-4da0639836b6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:23.479078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a466ee-1950-4bbe-89f4-4da0639836b6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:23.489687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae7f39-40dd-4a81-8a3c-7d7e666ea70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:23.490673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae7f39-40dd-4a81-8a3c-7d7e666ea70a admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:23.491497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae7f39-40dd-4a81-8a3c-7d7e666ea70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:23.491497 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae7f39-40dd-4a81-8a3c-7d7e666ea70a admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:23.492593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae7f39-40dd-4a81-8a3c-7d7e666ea70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:23.494511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae7f39-40dd-4a81-8a3c-7d7e666ea70a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:23.501830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:23.524982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1133/2296] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:23 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:23.527862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8cf70-78bb-4ddb-a6c8-71c087d6c1f4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:23.547621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8cf70-78bb-4ddb-a6c8-71c087d6c1f4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:23.555439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aafc9d-0c59-44c8-9695-0f1c9d428243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:23.557499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aafc9d-0c59-44c8-9695-0f1c9d428243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:23.558152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aafc9d-0c59-44c8-9695-0f1c9d428243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:23.558760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aafc9d-0c59-44c8-9695-0f1c9d428243 admin admin] PATH_INFO: `/v3/projects/2ce6326979954252aebc866f58aedfa9/users/946452c05d3c42b584bc0b059b7bd701/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:23.590748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aafc9d-0c59-44c8-9695-0f1c9d428243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce6326979954252aebc866f58aedfa9, user_id=946452c05d3c42b584bc0b059b7bd701, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:23.594887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aafc9d-0c59-44c8-9695-0f1c9d428243 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:23.619432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1164/2297] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:23 2022] PUT /identity/v3/projects/2ce6326979954252aebc866f58aedfa9/users/946452c05d3c42b584bc0b059b7bd701/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:23.622876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae7f39-40dd-4a81-8a3c-7d7e666ea70a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:23.646261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae7f39-40dd-4a81-8a3c-7d7e666ea70a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:23.856679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b67959-bc91-4980-8738-8af88c4edc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:23.858986 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b67959-bc91-4980-8738-8af88c4edc08 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:23.860743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b67959-bc91-4980-8738-8af88c4edc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:23.861220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b67959-bc91-4980-8738-8af88c4edc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:23.862170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b67959-bc91-4980-8738-8af88c4edc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:23.864666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b67959-bc91-4980-8738-8af88c4edc08 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:23.893264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1134/2298] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:23 2022] GET /identity/v3/roles => generated 1427 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:23.897830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aafc9d-0c59-44c8-9695-0f1c9d428243 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:23.927382 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aafc9d-0c59-44c8-9695-0f1c9d428243 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:23.939863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f10ad-9ae2-43f2-b323-fcfda979a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:23.941867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f10ad-9ae2-43f2-b323-fcfda979a1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:23.942353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f10ad-9ae2-43f2-b323-fcfda979a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:23.942783 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f10ad-9ae2-43f2-b323-fcfda979a1c9 admin admin] PATH_INFO: `/v3/projects/2ce6326979954252aebc866f58aedfa9/users/946452c05d3c42b584bc0b059b7bd701/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:23.945377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f10ad-9ae2-43f2-b323-fcfda979a1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce6326979954252aebc866f58aedfa9, user_id=946452c05d3c42b584bc0b059b7bd701, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:23.948631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f10ad-9ae2-43f2-b323-fcfda979a1c9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:24.002057 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1165/2299] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:23 2022] PUT /identity/v3/projects/2ce6326979954252aebc866f58aedfa9/users/946452c05d3c42b584bc0b059b7bd701/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:24.124231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d5e36-d1d1-438a-bcb6-1436536ac316 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:24.124231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d5e36-d1d1-438a-bcb6-1436536ac316 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:24.124231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d5e36-d1d1-438a-bcb6-1436536ac316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:24.164052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6b6d5e36-d1d1-438a-bcb6-1436536ac316 None None] MFA Rules not processed for user `946452c05d3c42b584bc0b059b7bd701`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:24.175947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6b6d5e36-d1d1-438a-bcb6-1436536ac316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:24.683025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1135/2300] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 588 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:24.693429 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f10ad-9ae2-43f2-b323-fcfda979a1c9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:24.695636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-889f10ad-9ae2-43f2-b323-fcfda979a1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:24.716274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:24.893857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f10ad-9ae2-43f2-b323-fcfda979a1c9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:24.905724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6899f4-aed0-4756-b66a-2938e7188885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:24.908754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6899f4-aed0-4756-b66a-2938e7188885 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:24.909052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6899f4-aed0-4756-b66a-2938e7188885 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:24.909330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6899f4-aed0-4756-b66a-2938e7188885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:24.930919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6899f4-aed0-4756-b66a-2938e7188885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:24.941574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6899f4-aed0-4756-b66a-2938e7188885 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:25.000407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1166/2301] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:25.208174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d5e36-d1d1-438a-bcb6-1436536ac316 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:25.221935 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d5e36-d1d1-438a-bcb6-1436536ac316 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:25.246562 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b58a8-454e-4031-b3d1-ad5d55077b04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:25.247244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b58a8-454e-4031-b3d1-ad5d55077b04 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:25.247523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b58a8-454e-4031-b3d1-ad5d55077b04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:25.247824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b58a8-454e-4031-b3d1-ad5d55077b04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:25.492335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b58a8-454e-4031-b3d1-ad5d55077b04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:25.495508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b58a8-454e-4031-b3d1-ad5d55077b04 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:25.514811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1136/2302] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:29.032623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6899f4-aed0-4756-b66a-2938e7188885 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:29.256806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6899f4-aed0-4756-b66a-2938e7188885 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:29.267575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:29.268486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:29.268772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:29.269053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] PATH_INFO: `/v3/users/7fd1fc0d1dc7437a814fcadb78520ac4` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:29.275192 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd1fc0d1dc7437a814fcadb78520ac4)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:29.278049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:29.306322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b678d-a4c7-4edd-a9e4-82b62b80f2b8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:29.307533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b678d-a4c7-4edd-a9e4-82b62b80f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:29.307960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b678d-a4c7-4edd-a9e4-82b62b80f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:29.375530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd1fc0d1dc7437a814fcadb78520ac4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:29.376818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd1fc0d1dc7437a814fcadb78520ac4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:29.403643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd1fc0d1dc7437a814fcadb78520ac4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:29.404627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd1fc0d1dc7437a814fcadb78520ac4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:29.425603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8f8ed3fb-9b65-47f3-b030-c66515af5e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd1fc0d1dc7437a814fcadb78520ac4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:29.449843 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-808b678d-a4c7-4edd-a9e4-82b62b80f2b8 None None] MFA Rules not processed for user `6a5af25e4340491bb3535c2f38226212`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:29.451203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-808b678d-a4c7-4edd-a9e4-82b62b80f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:29.497126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1167/2303] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:29 2022] DELETE /identity/v3/users/7fd1fc0d1dc7437a814fcadb78520ac4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:29.506507 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:29.509071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc65aa8-6c81-4d41-99f9-d55c53465b2d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:29.509608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc65aa8-6c81-4d41-99f9-d55c53465b2d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:29.510111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc65aa8-6c81-4d41-99f9-d55c53465b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:29.546394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dbc65aa8-6c81-4d41-99f9-d55c53465b2d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:29.552168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dbc65aa8-6c81-4d41-99f9-d55c53465b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:29.616564 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:29.723958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1137/2304] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:29.735818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1168/2305] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:29.747643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b678d-a4c7-4edd-a9e4-82b62b80f2b8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:29.750729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-808b678d-a4c7-4edd-a9e4-82b62b80f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:29.863455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b678d-a4c7-4edd-a9e4-82b62b80f2b8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:29.870048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc65aa8-6c81-4d41-99f9-d55c53465b2d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:29.871718 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dbc65aa8-6c81-4d41-99f9-d55c53465b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:29.988044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81d928-cd23-4f05-841d-d8176c6f2f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:29.989913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81d928-cd23-4f05-841d-d8176c6f2f42 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:29.990208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81d928-cd23-4f05-841d-d8176c6f2f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:29.990484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81d928-cd23-4f05-841d-d8176c6f2f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:30.017157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81d928-cd23-4f05-841d-d8176c6f2f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:30.018880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81d928-cd23-4f05-841d-d8176c6f2f42 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:30.035585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc65aa8-6c81-4d41-99f9-d55c53465b2d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:30.040683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1138/2306] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:30.048625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853605d6-0cc4-4fa8-837d-0edf7f7ecb72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:30.049298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853605d6-0cc4-4fa8-837d-0edf7f7ecb72 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:30.049577 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853605d6-0cc4-4fa8-837d-0edf7f7ecb72 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:30.049863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853605d6-0cc4-4fa8-837d-0edf7f7ecb72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:30.051864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-853605d6-0cc4-4fa8-837d-0edf7f7ecb72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:30.198422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853605d6-0cc4-4fa8-837d-0edf7f7ecb72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:30.200095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853605d6-0cc4-4fa8-837d-0edf7f7ecb72 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:30.236134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1169/2307] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:30.650371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81d928-cd23-4f05-841d-d8176c6f2f42 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:30.653698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-cc81d928-cd23-4f05-841d-d8176c6f2f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:30.670821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81d928-cd23-4f05-841d-d8176c6f2f42 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:30.677921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:30.688886 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:30.689275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:30.689669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] PATH_INFO: `/v3/projects/f5d5be3f28744acfb82a6d537f817398` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:30.698807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d5be3f28744acfb82a6d537f817398)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:30.701102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:30.793198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d5be3f28744acfb82a6d537f817398', 'request_id': 'req-06529a08-48b3-40bc-a540-c54b5be1d52a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:30.808816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d5be3f28744acfb82a6d537f817398', 'request_id': 'req-06529a08-48b3-40bc-a540-c54b5be1d52a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:30.828952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:30.837396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d5be3f28744acfb82a6d537f817398', 'request_id': 'req-06529a08-48b3-40bc-a540-c54b5be1d52a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:30.866343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] The token cache is being invalidate because project f5d5be3f28744acfb82a6d537f817398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:30.875214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:30.879155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:30.883275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1139/2308] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:30 2022] DELETE /identity/v3/projects/f5d5be3f28744acfb82a6d537f817398 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:30.891536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853605d6-0cc4-4fa8-837d-0edf7f7ecb72 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:30.901330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853605d6-0cc4-4fa8-837d-0edf7f7ecb72 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:31.058218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:31.061041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:31.061547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:31.062686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] PATH_INFO: `/v3/users/946452c05d3c42b584bc0b059b7bd701` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:31.067630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946452c05d3c42b584bc0b059b7bd701)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:31.070059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:31.082807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:31.154226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946452c05d3c42b584bc0b059b7bd701'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:31.157747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946452c05d3c42b584bc0b059b7bd701'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:31.185136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946452c05d3c42b584bc0b059b7bd701'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:31.188347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946452c05d3c42b584bc0b059b7bd701'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:31.214890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cfda9cf4-0d01-4fab-9b75-06971c9ece68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946452c05d3c42b584bc0b059b7bd701'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:31.242513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1170/2309] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:30 2022] DELETE /identity/v3/users/946452c05d3c42b584bc0b059b7bd701 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:31.972148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:31.974255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:32.009638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06529a08-48b3-40bc-a540-c54b5be1d52a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:32.179118 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:32.180268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:32.180923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:32.181598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] PATH_INFO: `/v3/projects/2ce6326979954252aebc866f58aedfa9` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:32.183072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce6326979954252aebc866f58aedfa9)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:32.185854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:32.287768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce6326979954252aebc866f58aedfa9', 'request_id': 'req-9731d159-f2e0-4327-aa8d-23886eaae47f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:32.299201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce6326979954252aebc866f58aedfa9', 'request_id': 'req-9731d159-f2e0-4327-aa8d-23886eaae47f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:32.319120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce6326979954252aebc866f58aedfa9', 'request_id': 'req-9731d159-f2e0-4327-aa8d-23886eaae47f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:32.368676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] The token cache is being invalidate because project 2ce6326979954252aebc866f58aedfa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:32.372402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:32.375410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9731d159-f2e0-4327-aa8d-23886eaae47f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:32.392126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1140/2310] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:31 2022] DELETE /identity/v3/projects/2ce6326979954252aebc866f58aedfa9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:32.398049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f830753-9cde-47fa-9776-3cf65b1feca5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:32.398616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f830753-9cde-47fa-9776-3cf65b1feca5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:32.398616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f830753-9cde-47fa-9776-3cf65b1feca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:32.405343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8743dce-f11a-4fb4-b2b5-2e146817ed7f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:32.405677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8743dce-f11a-4fb4-b2b5-2e146817ed7f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:32.405959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8743dce-f11a-4fb4-b2b5-2e146817ed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:32.483397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a8743dce-f11a-4fb4-b2b5-2e146817ed7f None None] MFA Rules not processed for user `fd48b33d8d974d5eb0d53e5959bb4c42`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:32.485248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a8743dce-f11a-4fb4-b2b5-2e146817ed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:32.493537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7f830753-9cde-47fa-9776-3cf65b1feca5 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:32.494784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7f830753-9cde-47fa-9776-3cf65b1feca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:32.664593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1141/2311] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:32.717218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1171/2312] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:32.726520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4c96-770c-43d3-84b3-1b8c01f04a10 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:32.726520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4c96-770c-43d3-84b3-1b8c01f04a10 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:32.726520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4c96-770c-43d3-84b3-1b8c01f04a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:32.770055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ca2e4c96-770c-43d3-84b3-1b8c01f04a10 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:32.775017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ca2e4c96-770c-43d3-84b3-1b8c01f04a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:32.799036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1142/2313] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:32.800121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f830753-9cde-47fa-9776-3cf65b1feca5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:32.825501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f830753-9cde-47fa-9776-3cf65b1feca5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:32.838159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3123459-9c7e-4733-b395-d06651a9ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:32.839329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3123459-9c7e-4733-b395-d06651a9ffdb admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:32.839642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3123459-9c7e-4733-b395-d06651a9ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:32.840422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3123459-9c7e-4733-b395-d06651a9ffdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:32.841177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3123459-9c7e-4733-b395-d06651a9ffdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:29:32.841488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3123459-9c7e-4733-b395-d06651a9ffdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:32.845603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3123459-9c7e-4733-b395-d06651a9ffdb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:32.873054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1172/2314] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:29:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:29:32.877134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4c96-770c-43d3-84b3-1b8c01f04a10 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:32.896191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4c96-770c-43d3-84b3-1b8c01f04a10 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:32.909158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ed93a-5a5d-4d5e-92dc-2c33844b59ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:32.915210 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ed93a-5a5d-4d5e-92dc-2c33844b59ce admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:32.917673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ed93a-5a5d-4d5e-92dc-2c33844b59ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:32.918131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ed93a-5a5d-4d5e-92dc-2c33844b59ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:32.920524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ed93a-5a5d-4d5e-92dc-2c33844b59ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:32.926830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ed93a-5a5d-4d5e-92dc-2c33844b59ce admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:32.966733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:33.001726 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1143/2315] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:32 2022] POST /identity/v3/projects => generated 384 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:33.005492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3123459-9c7e-4733-b395-d06651a9ffdb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:33.027479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3123459-9c7e-4733-b395-d06651a9ffdb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:33.173365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760998-dc51-4240-9f16-319a076ceee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:33.173984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760998-dc51-4240-9f16-319a076ceee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:33.174269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760998-dc51-4240-9f16-319a076ceee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:33.174893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760998-dc51-4240-9f16-319a076ceee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:33.182526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7760998-dc51-4240-9f16-319a076ceee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:33.187185 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7760998-dc51-4240-9f16-319a076ceee5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:33.207489 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:33.250679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1173/2316] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:33 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:33.255402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ed93a-5a5d-4d5e-92dc-2c33844b59ce admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:33.282548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ed93a-5a5d-4d5e-92dc-2c33844b59ce admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:33.300083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c3ff6-b0d6-432a-9c93-0b8d88b3ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:33.300791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c3ff6-b0d6-432a-9c93-0b8d88b3ca42 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:33.301146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c3ff6-b0d6-432a-9c93-0b8d88b3ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:33.303796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c3ff6-b0d6-432a-9c93-0b8d88b3ca42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:33.304847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c3ff6-b0d6-432a-9c93-0b8d88b3ca42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:33.310278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c3ff6-b0d6-432a-9c93-0b8d88b3ca42 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:33.348594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1144/2317] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:33 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:33.354432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760998-dc51-4240-9f16-319a076ceee5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:33.366329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760998-dc51-4240-9f16-319a076ceee5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:33.380454 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52a412-8891-4bd9-9ea7-225b92052c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:33.383745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52a412-8891-4bd9-9ea7-225b92052c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:33.384214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52a412-8891-4bd9-9ea7-225b92052c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:33.384662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52a412-8891-4bd9-9ea7-225b92052c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:33.385621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52a412-8891-4bd9-9ea7-225b92052c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:33.392140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52a412-8891-4bd9-9ea7-225b92052c5c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:33.461628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1174/2318] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:33 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:33.465975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c3ff6-b0d6-432a-9c93-0b8d88b3ca42 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:33.483340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c3ff6-b0d6-432a-9c93-0b8d88b3ca42 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:33.495429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ff09-ad43-4571-a52f-2489f55d97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:33.500469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ff09-ad43-4571-a52f-2489f55d97bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:33.504319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ff09-ad43-4571-a52f-2489f55d97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:33.504866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ff09-ad43-4571-a52f-2489f55d97bb admin admin] PATH_INFO: `/v3/projects/f0be8b966ddb47348797bacfd1045d19/users/e2189d409ca74582ad036c73dfa73aaa/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:33.566132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965ff09-ad43-4571-a52f-2489f55d97bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0be8b966ddb47348797bacfd1045d19, user_id=e2189d409ca74582ad036c73dfa73aaa, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:33.569138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965ff09-ad43-4571-a52f-2489f55d97bb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:33.623284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1145/2319] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:33 2022] PUT /identity/v3/projects/f0be8b966ddb47348797bacfd1045d19/users/e2189d409ca74582ad036c73dfa73aaa/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:33.634315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7f74d-b15d-4c83-871f-dc8588ca9318 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:33.634612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7f74d-b15d-4c83-871f-dc8588ca9318 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:33.634910 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7f74d-b15d-4c83-871f-dc8588ca9318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:33.694225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ff09-ad43-4571-a52f-2489f55d97bb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:33.696046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5965ff09-ad43-4571-a52f-2489f55d97bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:33.732456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d5e7f74d-b15d-4c83-871f-dc8588ca9318 None None] MFA Rules not processed for user `e2189d409ca74582ad036c73dfa73aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:33.735153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d5e7f74d-b15d-4c83-871f-dc8588ca9318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:33.949167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ff09-ad43-4571-a52f-2489f55d97bb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:33.978090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1175/2320] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:33.999196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7f74d-b15d-4c83-871f-dc8588ca9318 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:34.011200 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:34.017947 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:34.018324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:34.018671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] PATH_INFO: `/v3/users/095ce5b8fd4848beaf10bf64b16284f7` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:34.030203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095ce5b8fd4848beaf10bf64b16284f7)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:34.045945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:34.065058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7f74d-b15d-4c83-871f-dc8588ca9318 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:34.093444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ee62-4a32-4d16-bdaf-22aec76d1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:34.094387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ee62-4a32-4d16-bdaf-22aec76d1e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:34.096792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ee62-4a32-4d16-bdaf-22aec76d1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:34.097275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ee62-4a32-4d16-bdaf-22aec76d1e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:34.102935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ee62-4a32-4d16-bdaf-22aec76d1e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:34.105682 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ee62-4a32-4d16-bdaf-22aec76d1e00 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:34.210474 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1176/2321] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:33 2022] POST /identity/v3/projects => generated 382 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:34.216128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ee62-4a32-4d16-bdaf-22aec76d1e00 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:34.241725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095ce5b8fd4848beaf10bf64b16284f7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:34.242472 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095ce5b8fd4848beaf10bf64b16284f7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:34.273399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095ce5b8fd4848beaf10bf64b16284f7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:34.284165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095ce5b8fd4848beaf10bf64b16284f7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:34.284981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9340b4be-91db-4a39-9c6d-d5d51a630246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095ce5b8fd4848beaf10bf64b16284f7'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:34.324909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1146/2322] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:33 2022] DELETE /identity/v3/users/095ce5b8fd4848beaf10bf64b16284f7 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:34.331120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51d2c-c6b7-4ed1-9792-58bb1a393208 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:34.332394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51d2c-c6b7-4ed1-9792-58bb1a393208 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:34.333136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51d2c-c6b7-4ed1-9792-58bb1a393208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:34.408914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-37f51d2c-c6b7-4ed1-9792-58bb1a393208 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:34.414055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ee62-4a32-4d16-bdaf-22aec76d1e00 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:34.414803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-37f51d2c-c6b7-4ed1-9792-58bb1a393208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:34.531651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:34.563880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:34.577128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257e873-554d-4559-a3bd-face1410fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:34.578183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257e873-554d-4559-a3bd-face1410fc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:34.590281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257e873-554d-4559-a3bd-face1410fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:34.590567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257e873-554d-4559-a3bd-face1410fc61 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:34.591665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257e873-554d-4559-a3bd-face1410fc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:34.594546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257e873-554d-4559-a3bd-face1410fc61 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:34.625823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1147/2323] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:34.635461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51d2c-c6b7-4ed1-9792-58bb1a393208 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:34.636951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-37f51d2c-c6b7-4ed1-9792-58bb1a393208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:34.672835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1177/2324] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:34 2022] POST /identity/v3/users => generated 298 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:34.677659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257e873-554d-4559-a3bd-face1410fc61 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:34.683647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b257e873-554d-4559-a3bd-face1410fc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:34.718857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257e873-554d-4559-a3bd-face1410fc61 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:34.736844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509ad99-3215-4b82-a124-b1e5bad4ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:34.738032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509ad99-3215-4b82-a124-b1e5bad4ee62 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:34.738594 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509ad99-3215-4b82-a124-b1e5bad4ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:34.739068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509ad99-3215-4b82-a124-b1e5bad4ee62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:34.740183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509ad99-3215-4b82-a124-b1e5bad4ee62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:34.741886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509ad99-3215-4b82-a124-b1e5bad4ee62 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:34.783179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1178/2325] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:34 2022] GET /identity/v3/roles => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:34.784764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509ad99-3215-4b82-a124-b1e5bad4ee62 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:34.812403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509ad99-3215-4b82-a124-b1e5bad4ee62 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:34.817475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51d2c-c6b7-4ed1-9792-58bb1a393208 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:34.824084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d7add-6805-43cf-b19f-b2020abfe45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:34.825483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d7add-6805-43cf-b19f-b2020abfe45b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:34.825684 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d7add-6805-43cf-b19f-b2020abfe45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:34.826148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d7add-6805-43cf-b19f-b2020abfe45b admin admin] PATH_INFO: `/v3/projects/45e1cd873e464bf0b28407b78139e994/users/c3d38393d14445788f61e3a831733681/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:34.830191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ab06-f7da-4912-aa55-18b2c5752260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:34.831145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ab06-f7da-4912-aa55-18b2c5752260 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:34.831145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ab06-f7da-4912-aa55-18b2c5752260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:34.831374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ab06-f7da-4912-aa55-18b2c5752260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:34.871868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8ab06-f7da-4912-aa55-18b2c5752260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:34.873980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8ab06-f7da-4912-aa55-18b2c5752260 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:34.876487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d7add-6805-43cf-b19f-b2020abfe45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e1cd873e464bf0b28407b78139e994, user_id=c3d38393d14445788f61e3a831733681, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:34.879340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d7add-6805-43cf-b19f-b2020abfe45b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:34.918557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1179/2326] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:34 2022] PUT /identity/v3/projects/45e1cd873e464bf0b28407b78139e994/users/c3d38393d14445788f61e3a831733681/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:34.923162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d7add-6805-43cf-b19f-b2020abfe45b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:34.924795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1148/2327] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:35.139751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d7add-6805-43cf-b19f-b2020abfe45b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:35.194356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a87ae8-e604-4ff1-bd2e-0abd2a9e60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:35.195058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87ae8-e604-4ff1-bd2e-0abd2a9e60e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:35.195345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87ae8-e604-4ff1-bd2e-0abd2a9e60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:35.195655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a87ae8-e604-4ff1-bd2e-0abd2a9e60e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:35.196433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a87ae8-e604-4ff1-bd2e-0abd2a9e60e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:35.198378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a87ae8-e604-4ff1-bd2e-0abd2a9e60e2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:35.242895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1180/2328] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:34 2022] GET /identity/v3/roles => generated 1427 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:35.248702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ab06-f7da-4912-aa55-18b2c5752260 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:35.268677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ab06-f7da-4912-aa55-18b2c5752260 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:35.280047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba626-e557-4218-b293-baf8a399e29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:35.282029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba626-e557-4218-b293-baf8a399e29b admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:35.282404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba626-e557-4218-b293-baf8a399e29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:35.282696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba626-e557-4218-b293-baf8a399e29b admin admin] PATH_INFO: `/v3/projects/45e1cd873e464bf0b28407b78139e994/users/c3d38393d14445788f61e3a831733681/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:35.286025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbba626-e557-4218-b293-baf8a399e29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e1cd873e464bf0b28407b78139e994, user_id=c3d38393d14445788f61e3a831733681, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:35.297332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbba626-e557-4218-b293-baf8a399e29b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:35.325781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1149/2329] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:35 2022] PUT /identity/v3/projects/45e1cd873e464bf0b28407b78139e994/users/c3d38393d14445788f61e3a831733681/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:35.341339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28080a8-e5a2-4b0f-aadd-3f7eb94d9a2e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:35.342223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28080a8-e5a2-4b0f-aadd-3f7eb94d9a2e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:35.342787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28080a8-e5a2-4b0f-aadd-3f7eb94d9a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:35.434175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b28080a8-e5a2-4b0f-aadd-3f7eb94d9a2e None None] MFA Rules not processed for user `c3d38393d14445788f61e3a831733681`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:35.438312 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b28080a8-e5a2-4b0f-aadd-3f7eb94d9a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:35.639540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1181/2330] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:35.648266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba626-e557-4218-b293-baf8a399e29b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:35.650471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bbbba626-e557-4218-b293-baf8a399e29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:35.789815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba626-e557-4218-b293-baf8a399e29b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:35.798244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28080a8-e5a2-4b0f-aadd-3f7eb94d9a2e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:35.803457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405b17e-bb2a-4c16-9e20-7abeab0fe5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:35.804203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b28080a8-e5a2-4b0f-aadd-3f7eb94d9a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:35.804345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405b17e-bb2a-4c16-9e20-7abeab0fe5bd service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:35.804470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405b17e-bb2a-4c16-9e20-7abeab0fe5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:35.804733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405b17e-bb2a-4c16-9e20-7abeab0fe5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:35.840400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405b17e-bb2a-4c16-9e20-7abeab0fe5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:35.842301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405b17e-bb2a-4c16-9e20-7abeab0fe5bd service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:35.871175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:35.871631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1150/2331] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:35.923033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28080a8-e5a2-4b0f-aadd-3f7eb94d9a2e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:35.932731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:35.933968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:35.934383 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:35.934773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] PATH_INFO: `/v3/projects/9d220870b4434ee5921d3cefa70d62f9` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:35.936287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d220870b4434ee5921d3cefa70d62f9)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:35.938737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:36.019720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405b17e-bb2a-4c16-9e20-7abeab0fe5bd service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:36.034163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405b17e-bb2a-4c16-9e20-7abeab0fe5bd service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:36.045389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172903a-0f93-4968-a240-9f83c080ae01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:36.047697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172903a-0f93-4968-a240-9f83c080ae01 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:36.048408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172903a-0f93-4968-a240-9f83c080ae01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:36.049272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172903a-0f93-4968-a240-9f83c080ae01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:36.071594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f172903a-0f93-4968-a240-9f83c080ae01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:36.078764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d220870b4434ee5921d3cefa70d62f9', 'request_id': 'req-f073ec97-8658-4497-a42c-5d35617176da'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:36.094643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d220870b4434ee5921d3cefa70d62f9', 'request_id': 'req-f073ec97-8658-4497-a42c-5d35617176da'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:36.118468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d220870b4434ee5921d3cefa70d62f9', 'request_id': 'req-f073ec97-8658-4497-a42c-5d35617176da'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:36.165291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] The token cache is being invalidate because project 9d220870b4434ee5921d3cefa70d62f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:36.165849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:36.166632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f073ec97-8658-4497-a42c-5d35617176da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:36.169583 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1182/2332] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:35 2022] DELETE /identity/v3/projects/9d220870b4434ee5921d3cefa70d62f9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:36.174570 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e45a-c48c-4724-866d-fd5f9e509343 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:36.174990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e45a-c48c-4724-866d-fd5f9e509343 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:36.175361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e45a-c48c-4724-866d-fd5f9e509343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:36.212890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-60e3e45a-c48c-4724-866d-fd5f9e509343 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:36.216622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-60e3e45a-c48c-4724-866d-fd5f9e509343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:36.237738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172903a-0f93-4968-a240-9f83c080ae01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:36.239627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172903a-0f93-4968-a240-9f83c080ae01 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:36.254527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1151/2333] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:29:36.383406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1183/2334] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:36.391949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6cb4-c910-4e0f-ac2f-6009b5b9e528 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:36.392486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6cb4-c910-4e0f-ac2f-6009b5b9e528 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:36.392943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe6cb4-c910-4e0f-ac2f-6009b5b9e528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:36.442896 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2dfe6cb4-c910-4e0f-ac2f-6009b5b9e528 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:36.444683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2dfe6cb4-c910-4e0f-ac2f-6009b5b9e528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:36.466376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1152/2335] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:36.467338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3e45a-c48c-4724-866d-fd5f9e509343 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:36.480119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3e45a-c48c-4724-866d-fd5f9e509343 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:36.487647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d8952-e471-4f08-93b9-02da9ed8a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:36.488525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d8952-e471-4f08-93b9-02da9ed8a14f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:36.488990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d8952-e471-4f08-93b9-02da9ed8a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:36.489418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d8952-e471-4f08-93b9-02da9ed8a14f admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:36.490324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d8952-e471-4f08-93b9-02da9ed8a14f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:29:36.490788 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d8952-e471-4f08-93b9-02da9ed8a14f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:36.492719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d8952-e471-4f08-93b9-02da9ed8a14f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:36.522982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1184/2336] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:29:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:29:36.523188 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6cb4-c910-4e0f-ac2f-6009b5b9e528 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:36.536085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:36.558239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe6cb4-c910-4e0f-ac2f-6009b5b9e528 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:36.576184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24a01-10c7-42db-93a0-62ba38d52317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:36.577181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24a01-10c7-42db-93a0-62ba38d52317 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:36.577568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24a01-10c7-42db-93a0-62ba38d52317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:36.577959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd24a01-10c7-42db-93a0-62ba38d52317 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:36.578785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24a01-10c7-42db-93a0-62ba38d52317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:36.584640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd24a01-10c7-42db-93a0-62ba38d52317 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:36.663286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1153/2337] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:36 2022] POST /identity/v3/projects => generated 376 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:36.663741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d8952-e471-4f08-93b9-02da9ed8a14f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:36.683135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d8952-e471-4f08-93b9-02da9ed8a14f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:36.785279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:36.791021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24a01-10c7-42db-93a0-62ba38d52317 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:36.793065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fbd24a01-10c7-42db-93a0-62ba38d52317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:36.816724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe7cd8-f534-4612-ad53-6f6fc4297e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:36.818335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe7cd8-f534-4612-ad53-6f6fc4297e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:36.822740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe7cd8-f534-4612-ad53-6f6fc4297e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:36.823210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe7cd8-f534-4612-ad53-6f6fc4297e61 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:36.824433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe7cd8-f534-4612-ad53-6f6fc4297e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:36.826722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe7cd8-f534-4612-ad53-6f6fc4297e61 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:36.877724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1185/2338] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:36 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:29:36.880001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe7cd8-f534-4612-ad53-6f6fc4297e61 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:36.902193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe7cd8-f534-4612-ad53-6f6fc4297e61 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:36.914888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3961dc-740e-482e-a144-6b66b58360ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:36.915530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3961dc-740e-482e-a144-6b66b58360ae admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:36.915864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3961dc-740e-482e-a144-6b66b58360ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:36.916138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3961dc-740e-482e-a144-6b66b58360ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:36.917466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3961dc-740e-482e-a144-6b66b58360ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:36.937132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3961dc-740e-482e-a144-6b66b58360ae admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:36.949032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd24a01-10c7-42db-93a0-62ba38d52317 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:36.958119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:36.959293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:36.959616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:36.959903 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] PATH_INFO: `/v3/users/e2189d409ca74582ad036c73dfa73aaa` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:36.961956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2189d409ca74582ad036c73dfa73aaa)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:36.964919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:36.997097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1186/2339] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:36 2022] GET /identity/v3/roles => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:37.001817 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3961dc-740e-482e-a144-6b66b58360ae admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:37.021019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3961dc-740e-482e-a144-6b66b58360ae admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:37.035678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5ee1-4a5f-4d78-9365-17cb5bb4a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:37.036472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5ee1-4a5f-4d78-9365-17cb5bb4a050 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:37.037313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5ee1-4a5f-4d78-9365-17cb5bb4a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:37.037313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5ee1-4a5f-4d78-9365-17cb5bb4a050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:37.040027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb5ee1-4a5f-4d78-9365-17cb5bb4a050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:37.040027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb5ee1-4a5f-4d78-9365-17cb5bb4a050 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:37.072863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1187/2340] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:37 2022] GET /identity/v3/roles => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:29:37.073424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2189d409ca74582ad036c73dfa73aaa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:37.076384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2189d409ca74582ad036c73dfa73aaa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:37.076847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5ee1-4a5f-4d78-9365-17cb5bb4a050 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:37.079409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-69eb5ee1-4a5f-4d78-9365-17cb5bb4a050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:37.101046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5ee1-4a5f-4d78-9365-17cb5bb4a050 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:37.101985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2189d409ca74582ad036c73dfa73aaa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:37.119412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2189d409ca74582ad036c73dfa73aaa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:37.119780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c04b9-5562-40e0-9f51-67f393043ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:37.120675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c04b9-5562-40e0-9f51-67f393043ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:37.121038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c04b9-5562-40e0-9f51-67f393043ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:37.121392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c04b9-5562-40e0-9f51-67f393043ca3 admin admin] PATH_INFO: `/v3/projects/bbffcda5a3684171abc0c1c1353bf11c/users/fccb983350094858a767bafc51249c2f/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:37.122977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-220edabf-5d5b-4d8e-9794-67f0a8b267cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2189d409ca74582ad036c73dfa73aaa'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:37.150388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1154/2341] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:36 2022] DELETE /identity/v3/users/e2189d409ca74582ad036c73dfa73aaa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:37.156405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c04b9-5562-40e0-9f51-67f393043ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbffcda5a3684171abc0c1c1353bf11c, user_id=fccb983350094858a767bafc51249c2f, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:37.159531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c04b9-5562-40e0-9f51-67f393043ca3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:37.164711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d955-29d3-4514-9c27-2c3f6f3be769 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:37.166593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d955-29d3-4514-9c27-2c3f6f3be769 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:37.173026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d955-29d3-4514-9c27-2c3f6f3be769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:37.186554 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1188/2342] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:37 2022] PUT /identity/v3/projects/bbffcda5a3684171abc0c1c1353bf11c/users/fccb983350094858a767bafc51249c2f/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:29:37.200328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0d75-27bb-4967-b5b0-32a7b03fbf32 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:37.202277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0d75-27bb-4967-b5b0-32a7b03fbf32 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:37.202277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec0d75-27bb-4967-b5b0-32a7b03fbf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:37.256063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-beec0d75-27bb-4967-b5b0-32a7b03fbf32 None None] MFA Rules not processed for user `fccb983350094858a767bafc51249c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:37.258240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-beec0d75-27bb-4967-b5b0-32a7b03fbf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:37.260452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5f05d955-29d3-4514-9c27-2c3f6f3be769 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:37.261748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5f05d955-29d3-4514-9c27-2c3f6f3be769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:37.417862 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1189/2343] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:29:37.434857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0d75-27bb-4967-b5b0-32a7b03fbf32 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:37.438637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-beec0d75-27bb-4967-b5b0-32a7b03fbf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:37.442961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:37.471893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1155/2344] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:37.514389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05d955-29d3-4514-9c27-2c3f6f3be769 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:37.516320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5f05d955-29d3-4514-9c27-2c3f6f3be769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:37.655997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05d955-29d3-4514-9c27-2c3f6f3be769 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:37.672214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104201c8-0b4d-4f76-8869-f7a9053b4b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:37.672815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104201c8-0b4d-4f76-8869-f7a9053b4b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:37.673093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104201c8-0b4d-4f76-8869-f7a9053b4b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:37.678355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104201c8-0b4d-4f76-8869-f7a9053b4b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:37.720758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104201c8-0b4d-4f76-8869-f7a9053b4b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:37.722597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104201c8-0b4d-4f76-8869-f7a9053b4b0f service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:37.753187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1156/2345] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:29:37.815711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec0d75-27bb-4967-b5b0-32a7b03fbf32 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:37.821472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77861b6-ba8d-4657-be5a-2d04d3c9e874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:37.822525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77861b6-ba8d-4657-be5a-2d04d3c9e874 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:37.823933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77861b6-ba8d-4657-be5a-2d04d3c9e874 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:37.824390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77861b6-ba8d-4657-be5a-2d04d3c9e874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:37.837543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77861b6-ba8d-4657-be5a-2d04d3c9e874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:37.839514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77861b6-ba8d-4657-be5a-2d04d3c9e874 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:37.864988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1190/2346] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:38.534317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104201c8-0b4d-4f76-8869-f7a9053b4b0f service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:38.540333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-104201c8-0b4d-4f76-8869-f7a9053b4b0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:38.593875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eaa9e-2c1b-41ed-bb1b-5bf1e1c9cd4d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:38.594180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eaa9e-2c1b-41ed-bb1b-5bf1e1c9cd4d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:38.594440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eaa9e-2c1b-41ed-bb1b-5bf1e1c9cd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:38.615692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104201c8-0b4d-4f76-8869-f7a9053b4b0f service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:38.617012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-808eaa9e-2c1b-41ed-bb1b-5bf1e1c9cd4d None None] MFA Rules not processed for user `0e073346668d44e49bd8b94737a6dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:38.618513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-808eaa9e-2c1b-41ed-bb1b-5bf1e1c9cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:38.622704 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:38.624907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:38.625780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:38.626220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] PATH_INFO: `/v3/projects/f0be8b966ddb47348797bacfd1045d19` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:38.628468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0be8b966ddb47348797bacfd1045d19)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:38.631594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:38.659115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:38.728576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0be8b966ddb47348797bacfd1045d19', 'request_id': 'req-8925b883-5521-4811-a953-971bb35bff8f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:38.739863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1191/2347] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:38.747723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0be8b966ddb47348797bacfd1045d19', 'request_id': 'req-8925b883-5521-4811-a953-971bb35bff8f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:38.760012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0be8b966ddb47348797bacfd1045d19', 'request_id': 'req-8925b883-5521-4811-a953-971bb35bff8f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:38.774107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] The token cache is being invalidate because project f0be8b966ddb47348797bacfd1045d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:38.774548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:38.775382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:38.777399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1157/2348] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:38 2022] DELETE /identity/v3/projects/f0be8b966ddb47348797bacfd1045d19 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:38.781574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eaa9e-2c1b-41ed-bb1b-5bf1e1c9cd4d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:38.797921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eaa9e-2c1b-41ed-bb1b-5bf1e1c9cd4d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:38.927808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:38.935663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:38.936133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:38.937268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] PATH_INFO: `/v3/users/c3d38393d14445788f61e3a831733681` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:38.940538 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d38393d14445788f61e3a831733681)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:38.942675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:39.019933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d38393d14445788f61e3a831733681'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:39.021808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d38393d14445788f61e3a831733681'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:39.040565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d38393d14445788f61e3a831733681'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:39.041707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d38393d14445788f61e3a831733681'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:39.063798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7e322d41-6498-4295-ada1-fc0db233f69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d38393d14445788f61e3a831733681'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:39.098503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1192/2349] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:38 2022] DELETE /identity/v3/users/c3d38393d14445788f61e3a831733681 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:39.946464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:39.949230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:39.977698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925b883-5521-4811-a953-971bb35bff8f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:40.098460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:40.100614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:40.100614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:40.100811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] PATH_INFO: `/v3/projects/45e1cd873e464bf0b28407b78139e994` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:40.102032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e1cd873e464bf0b28407b78139e994)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:40.104987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:40.163815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:40.215058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e1cd873e464bf0b28407b78139e994', 'request_id': 'req-763a5168-1878-40ec-947d-49c7d1f15f9f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:40.240402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e1cd873e464bf0b28407b78139e994', 'request_id': 'req-763a5168-1878-40ec-947d-49c7d1f15f9f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:40.260170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e1cd873e464bf0b28407b78139e994', 'request_id': 'req-763a5168-1878-40ec-947d-49c7d1f15f9f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:40.300068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] The token cache is being invalidate because project 45e1cd873e464bf0b28407b78139e994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:40.300453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:40.303841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:40.319587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1158/2350] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:39 2022] DELETE /identity/v3/projects/45e1cd873e464bf0b28407b78139e994 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:40.664339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeba4f2-97e3-4d62-8c6d-09b7da82acb4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:40.665515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeba4f2-97e3-4d62-8c6d-09b7da82acb4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:40.666716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeba4f2-97e3-4d62-8c6d-09b7da82acb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:40.701948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7aeba4f2-97e3-4d62-8c6d-09b7da82acb4 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:40.703376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7aeba4f2-97e3-4d62-8c6d-09b7da82acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:40.764582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:40.786524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1193/2351] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:29:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:40.802096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:40.803526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:40.893753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a5168-1878-40ec-947d-49c7d1f15f9f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:40.899374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc81a-1bc3-4bb6-a7b1-2ed4795b2dfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:40.900049 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc81a-1bc3-4bb6-a7b1-2ed4795b2dfa service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:40.900328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc81a-1bc3-4bb6-a7b1-2ed4795b2dfa service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:40.900647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc81a-1bc3-4bb6-a7b1-2ed4795b2dfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:40.909773 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbc81a-1bc3-4bb6-a7b1-2ed4795b2dfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:40.911001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbc81a-1bc3-4bb6-a7b1-2ed4795b2dfa service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:40.921804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1159/2352] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:29:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:29:46.041665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b35e4f-6ce4-4c93-82a8-d826f1a784b3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:46.042775 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b35e4f-6ce4-4c93-82a8-d826f1a784b3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:46.043235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b35e4f-6ce4-4c93-82a8-d826f1a784b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:46.090400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-37b35e4f-6ce4-4c93-82a8-d826f1a784b3 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:46.096815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-37b35e4f-6ce4-4c93-82a8-d826f1a784b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:46.137291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1194/2353] 10.222.0.112 () {58 vars in 972 bytes} [Fri Jun 3 16:29:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:46.159234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc81a-1bc3-4bb6-a7b1-2ed4795b2dfa service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:46.208586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc81a-1bc3-4bb6-a7b1-2ed4795b2dfa service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:46.220726 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52dd45-dc03-4897-8368-9a0d5f18e2e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:46.221391 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52dd45-dc03-4897-8368-9a0d5f18e2e6 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:46.221673 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52dd45-dc03-4897-8368-9a0d5f18e2e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:46.222088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52dd45-dc03-4897-8368-9a0d5f18e2e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:46.243243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52dd45-dc03-4897-8368-9a0d5f18e2e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:46.244906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52dd45-dc03-4897-8368-9a0d5f18e2e6 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:46.283601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1160/2354] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:29:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:29:49.057751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b35e4f-6ce4-4c93-82a8-d826f1a784b3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:49.060550 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-37b35e4f-6ce4-4c93-82a8-d826f1a784b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:49.149585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b35e4f-6ce4-4c93-82a8-d826f1a784b3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:49.155168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:49.156376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:49.156813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:49.157221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] PATH_INFO: `/v3/users/777390bc7d4c47e3a50c834f13caa15c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:49.158710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777390bc7d4c47e3a50c834f13caa15c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:49.161014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:49.235340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777390bc7d4c47e3a50c834f13caa15c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.236363 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777390bc7d4c47e3a50c834f13caa15c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.244928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777390bc7d4c47e3a50c834f13caa15c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.245728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777390bc7d4c47e3a50c834f13caa15c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.269236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-244d3b0e-55ce-4e67-b931-3c1284bf29d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777390bc7d4c47e3a50c834f13caa15c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.295043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1195/2355] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:49 2022] DELETE /identity/v3/users/777390bc7d4c47e3a50c834f13caa15c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:49.515880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52dd45-dc03-4897-8368-9a0d5f18e2e6 service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:49.531664 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52dd45-dc03-4897-8368-9a0d5f18e2e6 service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:49.673383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:49.674292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:49.674590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:49.674858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] PATH_INFO: `/v3/projects/c037b844abc04632a37c3e3b3310bc12` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:49.676718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c037b844abc04632a37c3e3b3310bc12)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:49.678685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:49.735614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:49.748184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c037b844abc04632a37c3e3b3310bc12', 'request_id': 'req-f2b4dcdb-5d35-464d-bfd5-461e5c858975'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.756083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c037b844abc04632a37c3e3b3310bc12', 'request_id': 'req-f2b4dcdb-5d35-464d-bfd5-461e5c858975'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.765307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c037b844abc04632a37c3e3b3310bc12', 'request_id': 'req-f2b4dcdb-5d35-464d-bfd5-461e5c858975'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.777607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] The token cache is being invalidate because project c037b844abc04632a37c3e3b3310bc12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:49.777878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.778547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f2b4dcdb-5d35-464d-bfd5-461e5c858975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:49.780360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1161/2356] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:49 2022] DELETE /identity/v3/projects/c037b844abc04632a37c3e3b3310bc12 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:49.786203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f73b3-bbe1-42cb-aa3e-17333ffe8f05 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:49.786520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f73b3-bbe1-42cb-aa3e-17333ffe8f05 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:49.786804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f73b3-bbe1-42cb-aa3e-17333ffe8f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:49.806215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-231f73b3-bbe1-42cb-aa3e-17333ffe8f05 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:49.807694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-231f73b3-bbe1-42cb-aa3e-17333ffe8f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:49.858930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:49.875601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1196/2357] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:49.887031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188fb9c-65eb-4ccc-91b8-e02406126d34 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:49.887699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188fb9c-65eb-4ccc-91b8-e02406126d34 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:49.888021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188fb9c-65eb-4ccc-91b8-e02406126d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:49.911451 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c188fb9c-65eb-4ccc-91b8-e02406126d34 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:49.912806 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c188fb9c-65eb-4ccc-91b8-e02406126d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:49.922765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1162/2358] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:49.927403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f73b3-bbe1-42cb-aa3e-17333ffe8f05 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:49.939275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f73b3-bbe1-42cb-aa3e-17333ffe8f05 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:49.944333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec433d42-02f2-4e48-b727-ee43b17d7cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:49.945009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433d42-02f2-4e48-b727-ee43b17d7cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:49.945275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433d42-02f2-4e48-b727-ee43b17d7cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:49.945553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec433d42-02f2-4e48-b727-ee43b17d7cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:49.946461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec433d42-02f2-4e48-b727-ee43b17d7cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:29:49.946783 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec433d42-02f2-4e48-b727-ee43b17d7cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:49.949411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec433d42-02f2-4e48-b727-ee43b17d7cf6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:49.963206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1197/2359] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:29:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:29:49.968126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188fb9c-65eb-4ccc-91b8-e02406126d34 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:49.986206 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188fb9c-65eb-4ccc-91b8-e02406126d34 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:49.993835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fe51b-57f8-479d-8831-fdd50bc3bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:49.994699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fe51b-57f8-479d-8831-fdd50bc3bc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:49.995587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fe51b-57f8-479d-8831-fdd50bc3bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:49.995587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fe51b-57f8-479d-8831-fdd50bc3bc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:49.997213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fe51b-57f8-479d-8831-fdd50bc3bc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:50.000667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fe51b-57f8-479d-8831-fdd50bc3bc61 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:50.046763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1163/2360] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:49 2022] POST /identity/v3/projects => generated 370 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:50.048517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec433d42-02f2-4e48-b727-ee43b17d7cf6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:50.064235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec433d42-02f2-4e48-b727-ee43b17d7cf6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:50.176444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc389-72f1-4702-8e59-dd76401539bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:50.177377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc389-72f1-4702-8e59-dd76401539bd admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:50.177744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc389-72f1-4702-8e59-dd76401539bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:50.178219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc389-72f1-4702-8e59-dd76401539bd admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:50.178946 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc389-72f1-4702-8e59-dd76401539bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:50.184425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc389-72f1-4702-8e59-dd76401539bd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:50.227152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1198/2361] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:50 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:29:50.228328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fe51b-57f8-479d-8831-fdd50bc3bc61 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:50.240305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fe51b-57f8-479d-8831-fdd50bc3bc61 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:50.245463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544ba5f-574f-4a17-8e98-cb48f32fcfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:50.246176 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544ba5f-574f-4a17-8e98-cb48f32fcfba admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:50.246445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544ba5f-574f-4a17-8e98-cb48f32fcfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:50.246752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544ba5f-574f-4a17-8e98-cb48f32fcfba admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:50.247489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544ba5f-574f-4a17-8e98-cb48f32fcfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:50.250893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544ba5f-574f-4a17-8e98-cb48f32fcfba admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:50.268929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1164/2362] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:50 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:29:50.273771 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc389-72f1-4702-8e59-dd76401539bd admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:50.292576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc389-72f1-4702-8e59-dd76401539bd admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:50.300024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497bb78-8d43-4864-bd6b-eadf3ca672be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:50.300648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497bb78-8d43-4864-bd6b-eadf3ca672be admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:50.301071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497bb78-8d43-4864-bd6b-eadf3ca672be admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:50.301210 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497bb78-8d43-4864-bd6b-eadf3ca672be admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:50.302001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497bb78-8d43-4864-bd6b-eadf3ca672be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:50.303813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497bb78-8d43-4864-bd6b-eadf3ca672be admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:50.318433 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1199/2363] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:50 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:50.323790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544ba5f-574f-4a17-8e98-cb48f32fcfba admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:50.335930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544ba5f-574f-4a17-8e98-cb48f32fcfba admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:50.341331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a17b4-519d-4ab6-a1dc-a0dc8bc54ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:50.342747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a17b4-519d-4ab6-a1dc-a0dc8bc54ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:50.343047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a17b4-519d-4ab6-a1dc-a0dc8bc54ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:50.343434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a17b4-519d-4ab6-a1dc-a0dc8bc54ee2 admin admin] PATH_INFO: `/v3/projects/5ab44f64521f4ba28b678b01409c20c0/users/519e4a5eba2d4f3e91c8aeb494179050/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:50.369347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a17b4-519d-4ab6-a1dc-a0dc8bc54ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab44f64521f4ba28b678b01409c20c0, user_id=519e4a5eba2d4f3e91c8aeb494179050, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:50.372095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a17b4-519d-4ab6-a1dc-a0dc8bc54ee2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:50.393082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1165/2364] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:50 2022] PUT /identity/v3/projects/5ab44f64521f4ba28b678b01409c20c0/users/519e4a5eba2d4f3e91c8aeb494179050/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:50.405154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6c1d-415e-41b8-8621-880191f0f6c8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:50.405724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6c1d-415e-41b8-8621-880191f0f6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:50.406010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6c1d-415e-41b8-8621-880191f0f6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:50.436244 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a1dd6c1d-415e-41b8-8621-880191f0f6c8 None None] MFA Rules not processed for user `519e4a5eba2d4f3e91c8aeb494179050`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:50.437508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a1dd6c1d-415e-41b8-8621-880191f0f6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:50.529195 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1200/2365] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:50.537297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a17b4-519d-4ab6-a1dc-a0dc8bc54ee2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:50.539157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3e5a17b4-519d-4ab6-a1dc-a0dc8bc54ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:50.645889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a17b4-519d-4ab6-a1dc-a0dc8bc54ee2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:50.650955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954682b5-403f-4f27-8ec8-ef8c33d1c52c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f440bbc0414415186ae83d9fa3842bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:50.651722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954682b5-403f-4f27-8ec8-ef8c33d1c52c service glance] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:50.652071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954682b5-403f-4f27-8ec8-ef8c33d1c52c service glance] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:50.652411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954682b5-403f-4f27-8ec8-ef8c33d1c52c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:50.663001 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954682b5-403f-4f27-8ec8-ef8c33d1c52c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:50.664616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954682b5-403f-4f27-8ec8-ef8c33d1c52c service glance] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:50.699793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1166/2366] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:50.772621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6c1d-415e-41b8-8621-880191f0f6c8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:50.774233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a1dd6c1d-415e-41b8-8621-880191f0f6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:50.913099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:50.946770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6c1d-415e-41b8-8621-880191f0f6c8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:50.956260 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:50.957247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:50.957628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:50.958001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] PATH_INFO: `/v3/users/fccb983350094858a767bafc51249c2f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:50.960395 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fccb983350094858a767bafc51249c2f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:50.964406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:51.080650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fccb983350094858a767bafc51249c2f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:51.081572 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fccb983350094858a767bafc51249c2f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:51.091228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fccb983350094858a767bafc51249c2f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:51.092090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fccb983350094858a767bafc51249c2f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:51.129299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fccb983350094858a767bafc51249c2f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:51.185290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1201/2367] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:29:50 2022] DELETE /identity/v3/users/fccb983350094858a767bafc51249c2f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:51.189505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deaad5-a736-4255-ac1b-3c20b89adf99 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:51.190661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deaad5-a736-4255-ac1b-3c20b89adf99 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:51.191697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deaad5-a736-4255-ac1b-3c20b89adf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:51.218064 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-81deaad5-a736-4255-ac1b-3c20b89adf99 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:51.220109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-81deaad5-a736-4255-ac1b-3c20b89adf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:51.325612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1167/2368] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:51.363946 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:51.365434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:51.505714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312465-260c-426b-94c0-e7b486640669 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:51.521085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d700ea5-af00-4bf0-891f-efcda7c9d9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:51.521085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d700ea5-af00-4bf0-891f-efcda7c9d9fc service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:51.521085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d700ea5-af00-4bf0-891f-efcda7c9d9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:51.521085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d700ea5-af00-4bf0-891f-efcda7c9d9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:51.547894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d700ea5-af00-4bf0-891f-efcda7c9d9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:51.549242 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d700ea5-af00-4bf0-891f-efcda7c9d9fc service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:51.575011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1202/2369] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:29:52.108380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deaad5-a736-4255-ac1b-3c20b89adf99 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:52.111398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-81deaad5-a736-4255-ac1b-3c20b89adf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:52.120031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:52.132039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deaad5-a736-4255-ac1b-3c20b89adf99 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:52.150494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:52.182841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:52.183303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:52.183617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] PATH_INFO: `/v3/projects/bbffcda5a3684171abc0c1c1353bf11c` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:52.185113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbffcda5a3684171abc0c1c1353bf11c)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:52.187794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:52.313757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbffcda5a3684171abc0c1c1353bf11c', 'request_id': 'req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:52.322427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbffcda5a3684171abc0c1c1353bf11c', 'request_id': 'req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:52.385605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbffcda5a3684171abc0c1c1353bf11c', 'request_id': 'req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:52.409653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] The token cache is being invalidate because project bbffcda5a3684171abc0c1c1353bf11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:29:52.410062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:52.410623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-51e0dc3f-6e0c-4b0d-b7db-e5fae49bbba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:29:52.412581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1168/2370] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:29:52 2022] DELETE /identity/v3/projects/bbffcda5a3684171abc0c1c1353bf11c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:52.418625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3e79-aee7-489d-a022-ae6e3b525f6b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:52.419234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3e79-aee7-489d-a022-ae6e3b525f6b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:52.419895 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3e79-aee7-489d-a022-ae6e3b525f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:52.461847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e87f3e79-aee7-489d-a022-ae6e3b525f6b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:52.464770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e87f3e79-aee7-489d-a022-ae6e3b525f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:52.577938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f8ad-d0ab-4488-bddb-c6bc4ba0d7f0 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:52.578235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f8ad-d0ab-4488-bddb-c6bc4ba0d7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:52.578587 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f8ad-d0ab-4488-bddb-c6bc4ba0d7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:52.583546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1203/2371] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:52.605767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9221f8ad-d0ab-4488-bddb-c6bc4ba0d7f0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:52.607424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9221f8ad-d0ab-4488-bddb-c6bc4ba0d7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:52.618689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1169/2372] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:52.623773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f3e79-aee7-489d-a022-ae6e3b525f6b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:52.635652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f3e79-aee7-489d-a022-ae6e3b525f6b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:52.642568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205f24d-b218-4e99-881c-bfd9b1bf1d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:52.643371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205f24d-b218-4e99-881c-bfd9b1bf1d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:52.643815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205f24d-b218-4e99-881c-bfd9b1bf1d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:52.644281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205f24d-b218-4e99-881c-bfd9b1bf1d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:52.648868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205f24d-b218-4e99-881c-bfd9b1bf1d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:29:52.649534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205f24d-b218-4e99-881c-bfd9b1bf1d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:52.665642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205f24d-b218-4e99-881c-bfd9b1bf1d40 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:52.681032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:52.704193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1204/2373] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:29:52.705073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f8ad-d0ab-4488-bddb-c6bc4ba0d7f0 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:52.728262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f8ad-d0ab-4488-bddb-c6bc4ba0d7f0 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:52.734096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f125971-37c5-4420-8224-e06177bf0990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:52.734763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f125971-37c5-4420-8224-e06177bf0990 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:52.735046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f125971-37c5-4420-8224-e06177bf0990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:52.735422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f125971-37c5-4420-8224-e06177bf0990 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:52.736053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f125971-37c5-4420-8224-e06177bf0990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:52.738369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f125971-37c5-4420-8224-e06177bf0990 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:52.805417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1170/2374] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:29:52 2022] POST /identity/v3/projects => generated 392 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:29:52.806290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205f24d-b218-4e99-881c-bfd9b1bf1d40 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:52.824670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205f24d-b218-4e99-881c-bfd9b1bf1d40 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:52.945584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f8ac8-9392-4ea6-ac9d-6d0bf2c027ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:52.947080 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f8ac8-9392-4ea6-ac9d-6d0bf2c027ee admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:52.948040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f8ac8-9392-4ea6-ac9d-6d0bf2c027ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:52.948990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f8ac8-9392-4ea6-ac9d-6d0bf2c027ee admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:52.950537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f8ac8-9392-4ea6-ac9d-6d0bf2c027ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:52.954451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f8ac8-9392-4ea6-ac9d-6d0bf2c027ee admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:52.993270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1205/2375] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:29:52 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:29:52.995900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f125971-37c5-4420-8224-e06177bf0990 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:53.013525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f125971-37c5-4420-8224-e06177bf0990 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:53.027604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7731800-f857-4b18-bba6-2648c2ec5b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:53.029532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7731800-f857-4b18-bba6-2648c2ec5b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:53.031794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7731800-f857-4b18-bba6-2648c2ec5b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:53.032362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7731800-f857-4b18-bba6-2648c2ec5b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:53.033457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7731800-f857-4b18-bba6-2648c2ec5b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:53.036063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7731800-f857-4b18-bba6-2648c2ec5b3d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:53.064746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1171/2376] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:52 2022] GET /identity/v3/roles => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:29:53.065639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f8ac8-9392-4ea6-ac9d-6d0bf2c027ee admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:53.079611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f8ac8-9392-4ea6-ac9d-6d0bf2c027ee admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:53.088342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a6947-154a-4518-ad96-3d1238ca8d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:53.089497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a6947-154a-4518-ad96-3d1238ca8d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:53.089972 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a6947-154a-4518-ad96-3d1238ca8d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:53.090432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a6947-154a-4518-ad96-3d1238ca8d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:53.091957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a6947-154a-4518-ad96-3d1238ca8d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:53.094347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a6947-154a-4518-ad96-3d1238ca8d27 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:53.109170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1206/2377] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:29:53 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:29:53.113344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7731800-f857-4b18-bba6-2648c2ec5b3d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:53.126207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7731800-f857-4b18-bba6-2648c2ec5b3d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:53.135835 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff72fe-d4b5-48fe-b3ad-0bd0c2307d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:53.137996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff72fe-d4b5-48fe-b3ad-0bd0c2307d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:53.138677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff72fe-d4b5-48fe-b3ad-0bd0c2307d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:53.139322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff72fe-d4b5-48fe-b3ad-0bd0c2307d91 admin admin] PATH_INFO: `/v3/projects/3301f3b96e364cfebace8d9b6d7e2795/users/8f10b20d3f1d4476932ec49212700685/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:53.212520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff72fe-d4b5-48fe-b3ad-0bd0c2307d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3301f3b96e364cfebace8d9b6d7e2795, user_id=8f10b20d3f1d4476932ec49212700685, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:53.219686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff72fe-d4b5-48fe-b3ad-0bd0c2307d91 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:53.245018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1172/2378] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:29:53 2022] PUT /identity/v3/projects/3301f3b96e364cfebace8d9b6d7e2795/users/8f10b20d3f1d4476932ec49212700685/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:29:53.257036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e1c5-a1d5-4f73-849e-0418dce5f296 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:53.257036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e1c5-a1d5-4f73-849e-0418dce5f296 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:53.257361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e1c5-a1d5-4f73-849e-0418dce5f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:53.303024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6c76e1c5-a1d5-4f73-849e-0418dce5f296 None None] MFA Rules not processed for user `8f10b20d3f1d4476932ec49212700685`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:53.304733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6c76e1c5-a1d5-4f73-849e-0418dce5f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:53.433026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1207/2379] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:29:53.443507 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff72fe-d4b5-48fe-b3ad-0bd0c2307d91 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:29:53.445384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-02ff72fe-d4b5-48fe-b3ad-0bd0c2307d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:29:53.562381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff72fe-d4b5-48fe-b3ad-0bd0c2307d91 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:29:53.567954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88a15a-c68f-4b12-a7d7-ffd471ab7117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:29:53.568718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88a15a-c68f-4b12-a7d7-ffd471ab7117 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:53.569184 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88a15a-c68f-4b12-a7d7-ffd471ab7117 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:53.569538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88a15a-c68f-4b12-a7d7-ffd471ab7117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:53.581179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88a15a-c68f-4b12-a7d7-ffd471ab7117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:29:53.582911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88a15a-c68f-4b12-a7d7-ffd471ab7117 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:29:53.594523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1173/2380] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:29:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:29:59.867041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832941e-73da-4ac7-a51b-1420a92b3807 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:59.867636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832941e-73da-4ac7-a51b-1420a92b3807 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:59.867636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832941e-73da-4ac7-a51b-1420a92b3807 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:59.868985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1208/2381] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:29:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:29:59.875812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2dea5-7fc4-4281-a5c5-c11f148b182e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:29:59.876312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2dea5-7fc4-4281-a5c5-c11f148b182e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:29:59.876509 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2dea5-7fc4-4281-a5c5-c11f148b182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:29:59.883075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:59.932147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e7d2dea5-7fc4-4281-a5c5-c11f148b182e None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:29:59.933551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e7d2dea5-7fc4-4281-a5c5-c11f148b182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:00.026076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1174/2382] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:29:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:30:00.038179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832941e-73da-4ac7-a51b-1420a92b3807 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:00.040041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a832941e-73da-4ac7-a51b-1420a92b3807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:00.119975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832941e-73da-4ac7-a51b-1420a92b3807 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:00.123888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ae07a-fec9-4af9-a11b-c783f4ea192d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f440bbc0414415186ae83d9fa3842bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:00.124421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae07a-fec9-4af9-a11b-c783f4ea192d service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:00.124712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae07a-fec9-4af9-a11b-c783f4ea192d service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:00.125012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae07a-fec9-4af9-a11b-c783f4ea192d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:00.141116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ae07a-fec9-4af9-a11b-c783f4ea192d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:00.142814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ae07a-fec9-4af9-a11b-c783f4ea192d service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:00.156892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1209/2383] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:30:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:30:00.251930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070403b-6b97-4f25-a8f0-30eb50d40a48 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:00.252201 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070403b-6b97-4f25-a8f0-30eb50d40a48 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:00.252486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070403b-6b97-4f25-a8f0-30eb50d40a48 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:00.253910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1175/2384] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:30:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:30:00.258716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7b0cc-a140-4516-a0ff-6def06750788 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:00.259007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7b0cc-a140-4516-a0ff-6def06750788 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:00.259287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7b0cc-a140-4516-a0ff-6def06750788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:00.278044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d1a7b0cc-a140-4516-a0ff-6def06750788 None None] MFA Rules not processed for user `ed487d7f2dde42268c57a5330b6c5b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:30:00.279796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d1a7b0cc-a140-4516-a0ff-6def06750788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:00.284098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:00.336347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1210/2385] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:30:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:30:00.348407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070403b-6b97-4f25-a8f0-30eb50d40a48 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:00.350178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b070403b-6b97-4f25-a8f0-30eb50d40a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:00.364215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070403b-6b97-4f25-a8f0-30eb50d40a48 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:00.367738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c8a93-e9c3-4d66-9f7c-4a30eeca8e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:00.368372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c8a93-e9c3-4d66-9f7c-4a30eeca8e78 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:00.368657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c8a93-e9c3-4d66-9f7c-4a30eeca8e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:00.368932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c8a93-e9c3-4d66-9f7c-4a30eeca8e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:00.377292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c8a93-e9c3-4d66-9f7c-4a30eeca8e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:00.378733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c8a93-e9c3-4d66-9f7c-4a30eeca8e78 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:00.386842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1176/2386] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:30:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:30:00.502294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cfa7b-d047-42b4-877e-95745920db17 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:00.502607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cfa7b-d047-42b4-877e-95745920db17 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:00.502887 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cfa7b-d047-42b4-877e-95745920db17 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:00.504310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1211/2387] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:30:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:30:00.509644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71602dee-4c9c-4ca1-a379-5f0d5aeac9f3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:00.509937 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71602dee-4c9c-4ca1-a379-5f0d5aeac9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:00.510222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71602dee-4c9c-4ca1-a379-5f0d5aeac9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:00.529529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-71602dee-4c9c-4ca1-a379-5f0d5aeac9f3 None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:30:00.530730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-71602dee-4c9c-4ca1-a379-5f0d5aeac9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:00.540049 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1177/2388] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:30:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:30:00.551539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cfa7b-d047-42b4-877e-95745920db17 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:00.563066 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cfa7b-d047-42b4-877e-95745920db17 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:00.566553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bce4f-2f84-4db0-9cfa-05c792d8a72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:00.567179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bce4f-2f84-4db0-9cfa-05c792d8a72e service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:00.567491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bce4f-2f84-4db0-9cfa-05c792d8a72e service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:00.567769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bce4f-2f84-4db0-9cfa-05c792d8a72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:00.577669 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bce4f-2f84-4db0-9cfa-05c792d8a72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:00.579598 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bce4f-2f84-4db0-9cfa-05c792d8a72e service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:00.589821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1212/2389] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:30:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:30:03.414233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2e88-80be-468f-9a66-2b97998b9c6d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:03.414772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2e88-80be-468f-9a66-2b97998b9c6d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:03.414772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c2e88-80be-468f-9a66-2b97998b9c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:03.436038 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-770c2e88-80be-468f-9a66-2b97998b9c6d None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:30:03.437233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-770c2e88-80be-468f-9a66-2b97998b9c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:03.498883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1178/2390] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:30:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:30:03.510998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bce4f-2f84-4db0-9cfa-05c792d8a72e service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:03.512439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2a5bce4f-2f84-4db0-9cfa-05c792d8a72e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:03.585742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bce4f-2f84-4db0-9cfa-05c792d8a72e service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:03.591001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7464a-0612-49a4-b1b0-bca86ee54935 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:03.592409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7464a-0612-49a4-b1b0-bca86ee54935 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:03.592755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7464a-0612-49a4-b1b0-bca86ee54935 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:03.593079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7464a-0612-49a4-b1b0-bca86ee54935 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:03.602612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7464a-0612-49a4-b1b0-bca86ee54935 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:03.604285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7464a-0612-49a4-b1b0-bca86ee54935 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:03.613537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1213/2391] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:30:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:30:04.238347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2e88-80be-468f-9a66-2b97998b9c6d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:04.293751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:04.312373 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c2e88-80be-468f-9a66-2b97998b9c6d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:04.334264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:04.335050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:04.335407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:04.335858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] PATH_INFO: `/v3/users/8f10b20d3f1d4476932ec49212700685` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:04.337684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f10b20d3f1d4476932ec49212700685)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:04.339606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:04.425181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f10b20d3f1d4476932ec49212700685'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:04.426179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f10b20d3f1d4476932ec49212700685'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:04.458442 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f10b20d3f1d4476932ec49212700685'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:04.484759 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f10b20d3f1d4476932ec49212700685'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:04.485661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f10b20d3f1d4476932ec49212700685'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:04.503084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1179/2392] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:30:04 2022] DELETE /identity/v3/users/8f10b20d3f1d4476932ec49212700685 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:30:04.507800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446684-65a0-4a11-a76f-487ffd802a6d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:04.508670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446684-65a0-4a11-a76f-487ffd802a6d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:04.509023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446684-65a0-4a11-a76f-487ffd802a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:04.536954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-17446684-65a0-4a11-a76f-487ffd802a6d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:30:04.538235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-17446684-65a0-4a11-a76f-487ffd802a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:04.621212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1214/2393] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:30:04.632508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:04.634106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:04.708711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e336ee5-c6b9-42ac-916a-e30ab25f515f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:04.713017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e37e8-22f8-4f85-8265-7459713d38ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:04.713878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e37e8-22f8-4f85-8265-7459713d38ab service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:04.714255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e37e8-22f8-4f85-8265-7459713d38ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:04.714698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e37e8-22f8-4f85-8265-7459713d38ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:04.726712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e37e8-22f8-4f85-8265-7459713d38ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:04.728606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e37e8-22f8-4f85-8265-7459713d38ab service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:04.741104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1180/2394] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:30:05.152075 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446684-65a0-4a11-a76f-487ffd802a6d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:05.154935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-17446684-65a0-4a11-a76f-487ffd802a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:05.174994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446684-65a0-4a11-a76f-487ffd802a6d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:05.203973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:05.205042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:05.205541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:05.205928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] PATH_INFO: `/v3/projects/3301f3b96e364cfebace8d9b6d7e2795` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:05.209140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3301f3b96e364cfebace8d9b6d7e2795)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:05.212514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:05.292735 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:05.314386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3301f3b96e364cfebace8d9b6d7e2795', 'request_id': 'req-aff96265-1811-4df5-bd41-09bbde4d24dd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:05.322300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3301f3b96e364cfebace8d9b6d7e2795', 'request_id': 'req-aff96265-1811-4df5-bd41-09bbde4d24dd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:05.333213 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3301f3b96e364cfebace8d9b6d7e2795', 'request_id': 'req-aff96265-1811-4df5-bd41-09bbde4d24dd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:05.350903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] The token cache is being invalidate because project 3301f3b96e364cfebace8d9b6d7e2795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:30:05.351184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:05.351907 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-aff96265-1811-4df5-bd41-09bbde4d24dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:05.353914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1215/2395] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:30:05 2022] DELETE /identity/v3/projects/3301f3b96e364cfebace8d9b6d7e2795 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:30:14.735802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:15.347491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:16.504662 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e37e8-22f8-4f85-8265-7459713d38ab service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:16.506117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0c2e37e8-22f8-4f85-8265-7459713d38ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:16.519173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e37e8-22f8-4f85-8265-7459713d38ab service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:16.577817 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:16.578737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:16.578959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:16.579235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] PATH_INFO: `/v3/users/519e4a5eba2d4f3e91c8aeb494179050` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:16.580465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519e4a5eba2d4f3e91c8aeb494179050)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:16.582386 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:16.632336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519e4a5eba2d4f3e91c8aeb494179050'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:16.633020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519e4a5eba2d4f3e91c8aeb494179050'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:16.645150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519e4a5eba2d4f3e91c8aeb494179050'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:16.651995 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519e4a5eba2d4f3e91c8aeb494179050'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:16.652694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519e4a5eba2d4f3e91c8aeb494179050'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:16.669197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1181/2396] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:30:16 2022] DELETE /identity/v3/users/519e4a5eba2d4f3e91c8aeb494179050 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:30:16.675857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92281519-570b-46ad-96b8-14911220451a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:16.676679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92281519-570b-46ad-96b8-14911220451a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:16.676679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92281519-570b-46ad-96b8-14911220451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:16.695127 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-92281519-570b-46ad-96b8-14911220451a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:30:16.696315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-92281519-570b-46ad-96b8-14911220451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:16.761333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1216/2397] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:30:16.771335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:16.773164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:16.834500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb15376-1f17-42f5-bd67-df07b1c0a657 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:16.838261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a87be-ceca-4628-84d1-30195a8efb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:16.838991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a87be-ceca-4628-84d1-30195a8efb57 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:16.839278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a87be-ceca-4628-84d1-30195a8efb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:16.839563 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a87be-ceca-4628-84d1-30195a8efb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:16.850221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a87be-ceca-4628-84d1-30195a8efb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:16.851920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a87be-ceca-4628-84d1-30195a8efb57 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:16.862547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1182/2398] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:30:17.190009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92281519-570b-46ad-96b8-14911220451a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:17.192132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-92281519-570b-46ad-96b8-14911220451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:17.208853 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92281519-570b-46ad-96b8-14911220451a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:17.215529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:17.217278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:17.217579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:17.218482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] PATH_INFO: `/v3/projects/5ab44f64521f4ba28b678b01409c20c0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:17.219511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab44f64521f4ba28b678b01409c20c0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:17.221993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:17.283365 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab44f64521f4ba28b678b01409c20c0', 'request_id': 'req-2461a746-7f98-4f90-bc48-106ed548c078'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:17.289540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab44f64521f4ba28b678b01409c20c0', 'request_id': 'req-2461a746-7f98-4f90-bc48-106ed548c078'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:17.298347 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab44f64521f4ba28b678b01409c20c0', 'request_id': 'req-2461a746-7f98-4f90-bc48-106ed548c078'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:17.308749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] The token cache is being invalidate because project 5ab44f64521f4ba28b678b01409c20c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:30:17.309037 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:17.309667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2461a746-7f98-4f90-bc48-106ed548c078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:30:17.312027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1217/2399] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:30:17 2022] DELETE /identity/v3/projects/5ab44f64521f4ba28b678b01409c20c0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:30:18.082510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a87be-ceca-4628-84d1-30195a8efb57 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:18.083988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-656a87be-ceca-4628-84d1-30195a8efb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:18.095912 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a87be-ceca-4628-84d1-30195a8efb57 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:18.115205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:18.148971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:18.149677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:18.149958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:18.150234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:18.152069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:18.223614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:18.225134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:18.236646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1183/2400] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:30:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:30:21.589322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91c65-c07b-447d-9779-ba18afc048d7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:21.589827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91c65-c07b-447d-9779-ba18afc048d7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:21.589935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91c65-c07b-447d-9779-ba18afc048d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:21.643096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d1e91c65-c07b-447d-9779-ba18afc048d7 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:30:21.644359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d1e91c65-c07b-447d-9779-ba18afc048d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:21.698820 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:21.710819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1218/2401] 10.222.0.112 () {58 vars in 972 bytes} [Fri Jun 3 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:30:21.733122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:30:21.734733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:30:21.830572 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10719505-c2a6-4abf-a2fa-856574120c72 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:30:21.835901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dbdea-13c9-4576-8ed1-3ae00a0892e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:30:21.836563 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dbdea-13c9-4576-8ed1-3ae00a0892e2 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:30:21.837009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dbdea-13c9-4576-8ed1-3ae00a0892e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:30:21.837292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dbdea-13c9-4576-8ed1-3ae00a0892e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:30:21.848539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dbdea-13c9-4576-8ed1-3ae00a0892e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:30:21.850193 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33dbdea-13c9-4576-8ed1-3ae00a0892e2 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:30:21.859746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1184/2402] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:30:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:30:31.711600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:31.855755 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=81 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:31:00.686849 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91c65-c07b-447d-9779-ba18afc048d7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:31:00.688883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d1e91c65-c07b-447d-9779-ba18afc048d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:31:00.802940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91c65-c07b-447d-9779-ba18afc048d7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:31:00.808450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a44ed-396e-4be0-9931-6e39d537894b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:31:00.809118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a44ed-396e-4be0-9931-6e39d537894b service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:31:00.809969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a44ed-396e-4be0-9931-6e39d537894b service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:31:00.810259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a44ed-396e-4be0-9931-6e39d537894b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:31:00.812197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3d2a44ed-396e-4be0-9931-6e39d537894b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:31:00.826551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a44ed-396e-4be0-9931-6e39d537894b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:31:00.828310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a44ed-396e-4be0-9931-6e39d537894b service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:31:00.841499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1219/2403] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:31:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:31:04.518526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4d3a-d50c-49ac-9d0c-945ced2410f2 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:31:04.519088 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4d3a-d50c-49ac-9d0c-945ced2410f2 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:31:04.519174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d4d3a-d50c-49ac-9d0c-945ced2410f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:31:04.540123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d89d4d3a-d50c-49ac-9d0c-945ced2410f2 None None] MFA Rules not processed for user `0e073346668d44e49bd8b94737a6dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:31:04.541391 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d89d4d3a-d50c-49ac-9d0c-945ced2410f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:31:04.600328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1185/2404] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:31:04.792834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ae8d7-954f-41e0-84fc-72303df1e8d6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:31:04.793386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ae8d7-954f-41e0-84fc-72303df1e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:31:04.793386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ae8d7-954f-41e0-84fc-72303df1e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:31:04.816158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bc9ae8d7-954f-41e0-84fc-72303df1e8d6 None None] MFA Rules not processed for user `bdf91133123a468fbb8297092fd22484`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:31:04.817277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bc9ae8d7-954f-41e0-84fc-72303df1e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:31:04.876374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1220/2405] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:31:14.592829 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=25 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:31:14.868808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=66 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:31:47.529027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86b6d-cdbb-41a7-949b-a0ab7c443b42 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:31:47.529564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86b6d-cdbb-41a7-949b-a0ab7c443b42 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:31:47.529564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86b6d-cdbb-41a7-949b-a0ab7c443b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:31:47.547291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c8f86b6d-cdbb-41a7-949b-a0ab7c443b42 None None] MFA Rules not processed for user `b46af0c538244e1c9d2fe55470841d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:31:47.549048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c8f86b6d-cdbb-41a7-949b-a0ab7c443b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:31:47.603901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1186/2406] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:31:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:31:57.596809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=25 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:06.980971 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ae8d7-954f-41e0-84fc-72303df1e8d6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:06.982429 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bc9ae8d7-954f-41e0-84fc-72303df1e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:07.087938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ae8d7-954f-41e0-84fc-72303df1e8d6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:07.096304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:07.097343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.097530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.097794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] PATH_INFO: `/v3/users/0e073346668d44e49bd8b94737a6dafd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.099074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e073346668d44e49bd8b94737a6dafd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:07.101035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:07.149939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e073346668d44e49bd8b94737a6dafd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.150609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e073346668d44e49bd8b94737a6dafd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.157966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e073346668d44e49bd8b94737a6dafd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.158801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e073346668d44e49bd8b94737a6dafd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.166165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-676aff25-a80d-4e25-a344-2582dde00737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e073346668d44e49bd8b94737a6dafd'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.183541 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1221/2407] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:32:06 2022] DELETE /identity/v3/users/0e073346668d44e49bd8b94737a6dafd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:32:07.357064 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86b6d-cdbb-41a7-949b-a0ab7c443b42 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:07.369207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86b6d-cdbb-41a7-949b-a0ab7c443b42 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:07.425951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:07.426717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.426995 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.427267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] PATH_INFO: `/v3/projects/232f1604330b4672982783db3a59555b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.428453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232f1604330b4672982783db3a59555b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:07.430375 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:07.474742 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232f1604330b4672982783db3a59555b', 'request_id': 'req-8c8b8b30-4ba5-473a-bae3-33a949cdac58'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.481260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232f1604330b4672982783db3a59555b', 'request_id': 'req-8c8b8b30-4ba5-473a-bae3-33a949cdac58'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.488399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232f1604330b4672982783db3a59555b', 'request_id': 'req-8c8b8b30-4ba5-473a-bae3-33a949cdac58'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.498499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] The token cache is being invalidate because project 232f1604330b4672982783db3a59555b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:32:07.498784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.499408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8c8b8b30-4ba5-473a-bae3-33a949cdac58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:32:07.501182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1187/2408] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:32:07 2022] DELETE /identity/v3/projects/232f1604330b4672982783db3a59555b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:32:07.506446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875563-45bd-4721-b6d2-fa3a85d756e2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.506731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875563-45bd-4721-b6d2-fa3a85d756e2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.507009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875563-45bd-4721-b6d2-fa3a85d756e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.525314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2a875563-45bd-4721-b6d2-fa3a85d756e2 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:07.526498 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2a875563-45bd-4721-b6d2-fa3a85d756e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:07.584929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1222/2409] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:07.592471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448d4cd-e98b-4873-b17f-88a4725e7b3f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.592758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448d4cd-e98b-4873-b17f-88a4725e7b3f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.593031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448d4cd-e98b-4873-b17f-88a4725e7b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.611149 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d448d4cd-e98b-4873-b17f-88a4725e7b3f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:07.612898 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d448d4cd-e98b-4873-b17f-88a4725e7b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:07.620706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1188/2410] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:07.624868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a875563-45bd-4721-b6d2-fa3a85d756e2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:07.635193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a875563-45bd-4721-b6d2-fa3a85d756e2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:07.639874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0071a6-9d7b-43e3-a6d5-70aa6a563f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:07.640524 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0071a6-9d7b-43e3-a6d5-70aa6a563f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.640811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0071a6-9d7b-43e3-a6d5-70aa6a563f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.641089 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0071a6-9d7b-43e3-a6d5-70aa6a563f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.641816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0071a6-9d7b-43e3-a6d5-70aa6a563f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:32:07.642124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0071a6-9d7b-43e3-a6d5-70aa6a563f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:07.643812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0071a6-9d7b-43e3-a6d5-70aa6a563f25 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:07.655399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1223/2411] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:32:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:32:07.659697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448d4cd-e98b-4873-b17f-88a4725e7b3f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:07.669067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448d4cd-e98b-4873-b17f-88a4725e7b3f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:07.674956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ecac7-4deb-4545-95ca-319afe316412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:07.675667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ecac7-4deb-4545-95ca-319afe316412 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.676250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ecac7-4deb-4545-95ca-319afe316412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.676487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ecac7-4deb-4545-95ca-319afe316412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.677180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ecac7-4deb-4545-95ca-319afe316412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:07.679081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ecac7-4deb-4545-95ca-319afe316412 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:07.707723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1189/2412] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:32:07 2022] POST /identity/v3/projects => generated 386 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:32:07.712045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0071a6-9d7b-43e3-a6d5-70aa6a563f25 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:07.722703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0071a6-9d7b-43e3-a6d5-70aa6a563f25 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:07.726289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:07.781607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982ce5-9572-461a-92e4-9107fd7e9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:07.782266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982ce5-9572-461a-92e4-9107fd7e9bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.782548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982ce5-9572-461a-92e4-9107fd7e9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.782822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982ce5-9572-461a-92e4-9107fd7e9bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.784050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f982ce5-9572-461a-92e4-9107fd7e9bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:07.785974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f982ce5-9572-461a-92e4-9107fd7e9bd9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:07.806742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1224/2413] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:32:07 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:32:07.811061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ecac7-4deb-4545-95ca-319afe316412 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:07.821710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ecac7-4deb-4545-95ca-319afe316412 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:07.826365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e79b06-8cda-4cab-ac9e-251757141f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:07.827013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e79b06-8cda-4cab-ac9e-251757141f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.827299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e79b06-8cda-4cab-ac9e-251757141f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.827601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e79b06-8cda-4cab-ac9e-251757141f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.828362 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e79b06-8cda-4cab-ac9e-251757141f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:07.829961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e79b06-8cda-4cab-ac9e-251757141f16 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:07.840530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1190/2414] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:32:07 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:32:07.844494 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982ce5-9572-461a-92e4-9107fd7e9bd9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:07.855458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982ce5-9572-461a-92e4-9107fd7e9bd9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:07.860114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a09a9d-14f1-4f9f-9198-523e39d5bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:07.860761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a09a9d-14f1-4f9f-9198-523e39d5bd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.861044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a09a9d-14f1-4f9f-9198-523e39d5bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.861358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a09a9d-14f1-4f9f-9198-523e39d5bd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.862622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a09a9d-14f1-4f9f-9198-523e39d5bd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:07.864513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a09a9d-14f1-4f9f-9198-523e39d5bd41 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:07.876014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1225/2415] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:32:07 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:32:07.880312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e79b06-8cda-4cab-ac9e-251757141f16 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:07.890520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e79b06-8cda-4cab-ac9e-251757141f16 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:07.895709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d72e-cf64-4e2d-b002-d8959d9d668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:07.896596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d72e-cf64-4e2d-b002-d8959d9d668f admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.896880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d72e-cf64-4e2d-b002-d8959d9d668f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.897197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656d72e-cf64-4e2d-b002-d8959d9d668f admin admin] PATH_INFO: `/v3/projects/21b3185b2cd34f10ba0fad0748352809/users/435fe25611c8486e81afae7e81e2aa65/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.913092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656d72e-cf64-4e2d-b002-d8959d9d668f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b3185b2cd34f10ba0fad0748352809, user_id=435fe25611c8486e81afae7e81e2aa65, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:07.915794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656d72e-cf64-4e2d-b002-d8959d9d668f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:07.929756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1191/2416] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:32:07 2022] PUT /identity/v3/projects/21b3185b2cd34f10ba0fad0748352809/users/435fe25611c8486e81afae7e81e2aa65/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:32:07.934743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7391c0-69b0-429b-9d61-d0e00141fe99 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:07.935037 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7391c0-69b0-429b-9d61-d0e00141fe99 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:07.935316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7391c0-69b0-429b-9d61-d0e00141fe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:07.952241 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-aa7391c0-69b0-429b-9d61-d0e00141fe99 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:07.953466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aa7391c0-69b0-429b-9d61-d0e00141fe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:08.013171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1226/2417] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:08.022736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d72e-cf64-4e2d-b002-d8959d9d668f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:08.024459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c656d72e-cf64-4e2d-b002-d8959d9d668f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:08.057752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:08.086344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656d72e-cf64-4e2d-b002-d8959d9d668f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:08.090459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1293-b559-41f0-95d6-358be6c60b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:08.091157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1293-b559-41f0-95d6-358be6c60b8a service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:08.091438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1293-b559-41f0-95d6-358be6c60b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:08.091737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1293-b559-41f0-95d6-358be6c60b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:08.102141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c1293-b559-41f0-95d6-358be6c60b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:08.103893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c1293-b559-41f0-95d6-358be6c60b8a service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:08.114594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1192/2418] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:32:11.263598 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0f6ab-c9c7-4096-a6fb-1d2dedc088c6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:11.264116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0f6ab-c9c7-4096-a6fb-1d2dedc088c6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:11.264245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0f6ab-c9c7-4096-a6fb-1d2dedc088c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:11.286802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-dcb0f6ab-c9c7-4096-a6fb-1d2dedc088c6 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:11.288894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-dcb0f6ab-c9c7-4096-a6fb-1d2dedc088c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:11.360036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1227/2419] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:11.425008 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1293-b559-41f0-95d6-358be6c60b8a service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:11.426946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1b0c1293-b559-41f0-95d6-358be6c60b8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:11.519260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1293-b559-41f0-95d6-358be6c60b8a service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:11.526173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c717c5-96a8-42b1-9e9b-36792d144d81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:11.526879 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c717c5-96a8-42b1-9e9b-36792d144d81 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:11.527165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c717c5-96a8-42b1-9e9b-36792d144d81 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:11.527439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c717c5-96a8-42b1-9e9b-36792d144d81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:11.537891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c717c5-96a8-42b1-9e9b-36792d144d81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:11.540411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c717c5-96a8-42b1-9e9b-36792d144d81 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:11.552098 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1193/2420] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:32:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:32:12.921484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa94c9a-799b-494d-87f8-3151cdb4771c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:12.922661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa94c9a-799b-494d-87f8-3151cdb4771c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:12.922955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa94c9a-799b-494d-87f8-3151cdb4771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:12.991096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9aa94c9a-799b-494d-87f8-3151cdb4771c None None] MFA Rules not processed for user `435fe25611c8486e81afae7e81e2aa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:12.992713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9aa94c9a-799b-494d-87f8-3151cdb4771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:13.029202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:13.091652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1228/2421] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:13.110137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c717c5-96a8-42b1-9e9b-36792d144d81 service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:13.111798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f6c717c5-96a8-42b1-9e9b-36792d144d81 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:13.299967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c717c5-96a8-42b1-9e9b-36792d144d81 service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:13.317421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21855b-408b-483f-803f-ed087e1aef45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:13.318419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21855b-408b-483f-803f-ed087e1aef45 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:13.320309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21855b-408b-483f-803f-ed087e1aef45 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:13.320616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21855b-408b-483f-803f-ed087e1aef45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:13.339765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21855b-408b-483f-803f-ed087e1aef45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:13.341560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21855b-408b-483f-803f-ed087e1aef45 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:13.386739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1194/2422] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:32:15.410246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a1db-9f7d-4e6e-a9b4-032cbf28316a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:15.411236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a1db-9f7d-4e6e-a9b4-032cbf28316a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:15.411716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a1db-9f7d-4e6e-a9b4-032cbf28316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:15.430628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-11c4a1db-9f7d-4e6e-a9b4-032cbf28316a None None] MFA Rules not processed for user `435fe25611c8486e81afae7e81e2aa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:15.432369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-11c4a1db-9f7d-4e6e-a9b4-032cbf28316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:15.459652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1229/2423] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:32:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:23.357424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=80 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:25.424745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=21 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:32.023461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e144b8-5668-4c52-9558-88596f707e58 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:32.024074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e144b8-5668-4c52-9558-88596f707e58 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:32.024074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e144b8-5668-4c52-9558-88596f707e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:32.044910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a5e144b8-5668-4c52-9558-88596f707e58 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:32.046073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a5e144b8-5668-4c52-9558-88596f707e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:32.054892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1195/2424] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:32.067619 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4a1db-9f7d-4e6e-a9b4-032cbf28316a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:32.080095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4a1db-9f7d-4e6e-a9b4-032cbf28316a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:32.085561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8c153-618e-49a0-aabd-c85b18b008ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:32.086224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8c153-618e-49a0-aabd-c85b18b008ee service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:32.086508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8c153-618e-49a0-aabd-c85b18b008ee service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:32.086785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8c153-618e-49a0-aabd-c85b18b008ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:32.096404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8c153-618e-49a0-aabd-c85b18b008ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:32.098016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8c153-618e-49a0-aabd-c85b18b008ee service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:32.108151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1230/2425] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:32:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:32:32.581789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc17b6d-b3b3-40d4-90c7-dc1db33a2756 None None] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:32.582294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc17b6d-b3b3-40d4-90c7-dc1db33a2756 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:32.582700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc17b6d-b3b3-40d4-90c7-dc1db33a2756 None None] PATH_INFO: `/` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:32.584285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1196/2426] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:32:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:32:32.602506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a4f2b-73a6-4c43-b8f7-79910012fdf3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:32.602828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a4f2b-73a6-4c43-b8f7-79910012fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:32.603112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a4f2b-73a6-4c43-b8f7-79910012fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:32.630710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e32a4f2b-73a6-4c43-b8f7-79910012fdf3 None None] MFA Rules not processed for user `ed487d7f2dde42268c57a5330b6c5b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:32.632654 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e32a4f2b-73a6-4c43-b8f7-79910012fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:32.652954 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1231/2427] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:32.661391 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc17b6d-b3b3-40d4-90c7-dc1db33a2756 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:32.663220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9cc17b6d-b3b3-40d4-90c7-dc1db33a2756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:32.690144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc17b6d-b3b3-40d4-90c7-dc1db33a2756 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:32.694213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df140b9a-1b3b-4d93-be16-cf3166001b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:32.695035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df140b9a-1b3b-4d93-be16-cf3166001b1f service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:32.695390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df140b9a-1b3b-4d93-be16-cf3166001b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:32.695766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df140b9a-1b3b-4d93-be16-cf3166001b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:32.704786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df140b9a-1b3b-4d93-be16-cf3166001b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:32.706353 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df140b9a-1b3b-4d93-be16-cf3166001b1f service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:32.716479 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1197/2428] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:32:32.864530 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bda6a-2a42-4a2b-9aef-eb5c109e275a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:32.864945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bda6a-2a42-4a2b-9aef-eb5c109e275a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:32.865327 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bda6a-2a42-4a2b-9aef-eb5c109e275a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:32.867167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1232/2429] 10.222.0.112 () {54 vars in 926 bytes} [Fri Jun 3 16:32:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jun 03 16:32:32.873112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367529ed-750f-4016-93ec-92c8abafaaeb None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:32.873394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367529ed-750f-4016-93ec-92c8abafaaeb None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:32.873674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367529ed-750f-4016-93ec-92c8abafaaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:32.896626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-367529ed-750f-4016-93ec-92c8abafaaeb None None] MFA Rules not processed for user `3a650b8d49ad480bb1620209a8b7c6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:32.898680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-367529ed-750f-4016-93ec-92c8abafaaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:32.908992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1198/2430] 10.222.0.112 () {58 vars in 1023 bytes} [Fri Jun 3 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:32.920000 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bda6a-2a42-4a2b-9aef-eb5c109e275a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:32.933515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bda6a-2a42-4a2b-9aef-eb5c109e275a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:32.938284 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81f69-8881-4d41-aa34-37da3c27f329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:32.938938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81f69-8881-4d41-aa34-37da3c27f329 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:32.939219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81f69-8881-4d41-aa34-37da3c27f329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:32.939493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81f69-8881-4d41-aa34-37da3c27f329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:32.954826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81f69-8881-4d41-aa34-37da3c27f329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:32.956717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81f69-8881-4d41-aa34-37da3c27f329 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:32.981696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1233/2431] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:32:34.263939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367529ed-750f-4016-93ec-92c8abafaaeb None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:34.276275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367529ed-750f-4016-93ec-92c8abafaaeb None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:34.280573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af9e4-b3ea-45ae-949c-c00a3ae51a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:34.281237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af9e4-b3ea-45ae-949c-c00a3ae51a5c service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:34.281542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af9e4-b3ea-45ae-949c-c00a3ae51a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:34.282340 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af9e4-b3ea-45ae-949c-c00a3ae51a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:34.284180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f28af9e4-b3ea-45ae-949c-c00a3ae51a5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:34.301813 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28af9e4-b3ea-45ae-949c-c00a3ae51a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:34.303285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28af9e4-b3ea-45ae-949c-c00a3ae51a5c service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:34.315981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1199/2432] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:32:35.077039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81f69-8881-4d41-aa34-37da3c27f329 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:35.087308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81f69-8881-4d41-aa34-37da3c27f329 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:35.091449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29369a8d-a1c0-4205-9f71-4807273abd48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:35.092420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369a8d-a1c0-4205-9f71-4807273abd48 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:35.092928 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369a8d-a1c0-4205-9f71-4807273abd48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:35.093428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29369a8d-a1c0-4205-9f71-4807273abd48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:35.095831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-29369a8d-a1c0-4205-9f71-4807273abd48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:35.112310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29369a8d-a1c0-4205-9f71-4807273abd48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:35.113761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29369a8d-a1c0-4205-9f71-4807273abd48 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:35.126818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1234/2433] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:32:44.310912 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=18 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:45.120184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=21 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:46.298670 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af9e4-b3ea-45ae-949c-c00a3ae51a5c service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:46.308315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af9e4-b3ea-45ae-949c-c00a3ae51a5c service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:46.312071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c29f-80eb-4611-a67b-8aadfb5b3f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:46.313245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c29f-80eb-4611-a67b-8aadfb5b3f13 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:46.313523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c29f-80eb-4611-a67b-8aadfb5b3f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:46.313793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0c29f-80eb-4611-a67b-8aadfb5b3f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:46.315667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6fc0c29f-80eb-4611-a67b-8aadfb5b3f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:46.326487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0c29f-80eb-4611-a67b-8aadfb5b3f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:46.328778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0c29f-80eb-4611-a67b-8aadfb5b3f13 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:46.338277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1200/2434] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:32:47.551330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45374976-29a7-4019-b71b-f936fc8b86ac None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:47.552164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45374976-29a7-4019-b71b-f936fc8b86ac None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:47.552164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45374976-29a7-4019-b71b-f936fc8b86ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:47.571265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-45374976-29a7-4019-b71b-f936fc8b86ac None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:32:47.572797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-45374976-29a7-4019-b71b-f936fc8b86ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:47.580518 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1235/2435] 10.222.0.112 () {58 vars in 972 bytes} [Fri Jun 3 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:32:47.596830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c29f-80eb-4611-a67b-8aadfb5b3f13 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:47.610127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0c29f-80eb-4611-a67b-8aadfb5b3f13 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:47.615909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343e168-4e44-49c9-9fb3-e31317d15b10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:47.616573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343e168-4e44-49c9-9fb3-e31317d15b10 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:47.616856 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343e168-4e44-49c9-9fb3-e31317d15b10 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:47.617135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343e168-4e44-49c9-9fb3-e31317d15b10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:47.626887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343e168-4e44-49c9-9fb3-e31317d15b10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:47.628828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343e168-4e44-49c9-9fb3-e31317d15b10 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:47.638232 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1201/2436] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:32:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:32:53.831335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45374976-29a7-4019-b71b-f936fc8b86ac None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:53.833466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-45374976-29a7-4019-b71b-f936fc8b86ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:53.888291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343e168-4e44-49c9-9fb3-e31317d15b10 service swift] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:53.889885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f343e168-4e44-49c9-9fb3-e31317d15b10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:53.925924 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45374976-29a7-4019-b71b-f936fc8b86ac None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:53.933414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9049bfe-6e21-4fa5-a329-4c1c38826df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:53.934575 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9049bfe-6e21-4fa5-a329-4c1c38826df2 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:53.935102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9049bfe-6e21-4fa5-a329-4c1c38826df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:53.935661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9049bfe-6e21-4fa5-a329-4c1c38826df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:53.939540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c9049bfe-6e21-4fa5-a329-4c1c38826df2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:53.959888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343e168-4e44-49c9-9fb3-e31317d15b10 service swift] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:53.963574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:53.964261 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:53.964545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:53.964824 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:53.966674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:54.032010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9049bfe-6e21-4fa5-a329-4c1c38826df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:54.033892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:54.035134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9049bfe-6e21-4fa5-a329-4c1c38826df2 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:54.036513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:54.052758 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1202/2437] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:32:54.053776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1236/2438] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:32:58.743802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:32:58.747890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:58.788746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e243aa0-5ecc-4919-a2df-4ae2c0d6ecf4 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:32:58.806134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:32:58.807860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:32:58.808603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:32:58.809264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:32:58.815772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:32:58.845781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:32:58.848844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:32:58.888244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1203/2439] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:04.046532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=51 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:04.762911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9049bfe-6e21-4fa5-a329-4c1c38826df2 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:04.777597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9049bfe-6e21-4fa5-a329-4c1c38826df2 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:04.783022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adbd5a-043c-4d47-adbb-ba706092c68c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:04.783715 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adbd5a-043c-4d47-adbb-ba706092c68c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:04.784002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adbd5a-043c-4d47-adbb-ba706092c68c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:04.784280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adbd5a-043c-4d47-adbb-ba706092c68c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:04.786106 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b8adbd5a-043c-4d47-adbb-ba706092c68c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:04.799331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adbd5a-043c-4d47-adbb-ba706092c68c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:04.800819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adbd5a-043c-4d47-adbb-ba706092c68c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:04.811092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1237/2440] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:08.623404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:08.625972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:08.642462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4101600-895f-4bd7-9add-1a76efc96386 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:08.648502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:08.649614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:08.650044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:08.650222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] PATH_INFO: `/v3/users/b46af0c538244e1c9d2fe55470841d15` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:08.651478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46af0c538244e1c9d2fe55470841d15)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:08.653443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:08.709473 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46af0c538244e1c9d2fe55470841d15'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:08.710278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46af0c538244e1c9d2fe55470841d15'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:08.727407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46af0c538244e1c9d2fe55470841d15'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:08.732277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:08.735780 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46af0c538244e1c9d2fe55470841d15'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:08.736894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-4d183424-248a-4d42-be9f-51e339bef0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46af0c538244e1c9d2fe55470841d15'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:08.753223 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1204/2441] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:08 2022] DELETE /identity/v3/users/b46af0c538244e1c9d2fe55470841d15 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:08.953636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adbd5a-043c-4d47-adbb-ba706092c68c service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:08.972237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adbd5a-043c-4d47-adbb-ba706092c68c service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.079542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.081134 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.081674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.082206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] PATH_INFO: `/v3/projects/a8dede52b25a418ea3372f9dd70bbff0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.084403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8dede52b25a418ea3372f9dd70bbff0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.088380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.161851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8dede52b25a418ea3372f9dd70bbff0', 'request_id': 'req-3aca1879-44ca-4ef4-8326-f9a8d81786c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:09.168602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8dede52b25a418ea3372f9dd70bbff0', 'request_id': 'req-3aca1879-44ca-4ef4-8326-f9a8d81786c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:09.176642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8dede52b25a418ea3372f9dd70bbff0', 'request_id': 'req-3aca1879-44ca-4ef4-8326-f9a8d81786c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:09.187923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] The token cache is being invalidate because project a8dede52b25a418ea3372f9dd70bbff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:09.188215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:09.188885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3aca1879-44ca-4ef4-8326-f9a8d81786c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:09.190492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1238/2442] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:08 2022] DELETE /identity/v3/projects/a8dede52b25a418ea3372f9dd70bbff0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:09.195829 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92cc88-3629-4ad9-8831-5502b1341cef None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.196073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92cc88-3629-4ad9-8831-5502b1341cef None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.196313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92cc88-3629-4ad9-8831-5502b1341cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.215174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0a92cc88-3629-4ad9-8831-5502b1341cef None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:09.216455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0a92cc88-3629-4ad9-8831-5502b1341cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:09.279605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1205/2443] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:09.287428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf5123-d097-48c5-b041-ff435cd67260 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.287748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf5123-d097-48c5-b041-ff435cd67260 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.288024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf5123-d097-48c5-b041-ff435cd67260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.306597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c3cf5123-d097-48c5-b041-ff435cd67260 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:09.307865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c3cf5123-d097-48c5-b041-ff435cd67260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:09.316465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1239/2444] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:09.320761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92cc88-3629-4ad9-8831-5502b1341cef None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:09.331210 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92cc88-3629-4ad9-8831-5502b1341cef None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.335956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c010a0a-089c-4646-9ae0-34a1f8932456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.336621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c010a0a-089c-4646-9ae0-34a1f8932456 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.342168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c010a0a-089c-4646-9ae0-34a1f8932456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.342168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c010a0a-089c-4646-9ae0-34a1f8932456 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.342168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c010a0a-089c-4646-9ae0-34a1f8932456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:09.342168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c010a0a-089c-4646-9ae0-34a1f8932456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.342168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c010a0a-089c-4646-9ae0-34a1f8932456 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.353015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1206/2445] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:33:09.357515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf5123-d097-48c5-b041-ff435cd67260 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:09.367197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf5123-d097-48c5-b041-ff435cd67260 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.371875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be2eb-e3c1-4e9c-ad42-429115bd7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.372559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be2eb-e3c1-4e9c-ad42-429115bd7214 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.372840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be2eb-e3c1-4e9c-ad42-429115bd7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.373131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be2eb-e3c1-4e9c-ad42-429115bd7214 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.374321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81be2eb-e3c1-4e9c-ad42-429115bd7214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.376269 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81be2eb-e3c1-4e9c-ad42-429115bd7214 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.406902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1240/2446] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:09 2022] POST /identity/v3/projects => generated 366 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:09.408076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c010a0a-089c-4646-9ae0-34a1f8932456 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:09.418627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c010a0a-089c-4646-9ae0-34a1f8932456 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.486875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bef13-886e-4a62-9d63-d89dfcafb94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.487675 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bef13-886e-4a62-9d63-d89dfcafb94a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.488011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bef13-886e-4a62-9d63-d89dfcafb94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.488416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bef13-886e-4a62-9d63-d89dfcafb94a admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.489058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bef13-886e-4a62-9d63-d89dfcafb94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.491020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bef13-886e-4a62-9d63-d89dfcafb94a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.522771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1207/2447] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:09 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:09.523974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be2eb-e3c1-4e9c-ad42-429115bd7214 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:09.535505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be2eb-e3c1-4e9c-ad42-429115bd7214 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.541033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e7634-238a-4d57-8b83-ae3e6ec19f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.541703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e7634-238a-4d57-8b83-ae3e6ec19f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.541983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e7634-238a-4d57-8b83-ae3e6ec19f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.542256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e7634-238a-4d57-8b83-ae3e6ec19f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.543035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e7634-238a-4d57-8b83-ae3e6ec19f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.544657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e7634-238a-4d57-8b83-ae3e6ec19f41 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.557011 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1241/2448] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:09 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:09.561145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bef13-886e-4a62-9d63-d89dfcafb94a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:09.571531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bef13-886e-4a62-9d63-d89dfcafb94a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.576222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a28e95-2f4b-4f52-a66f-c019075a96db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.577311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28e95-2f4b-4f52-a66f-c019075a96db admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.577311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28e95-2f4b-4f52-a66f-c019075a96db admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.577514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28e95-2f4b-4f52-a66f-c019075a96db admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.578238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a28e95-2f4b-4f52-a66f-c019075a96db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.579873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a28e95-2f4b-4f52-a66f-c019075a96db admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.590251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1208/2449] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:09 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:09.595228 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e7634-238a-4d57-8b83-ae3e6ec19f41 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:09.605563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e7634-238a-4d57-8b83-ae3e6ec19f41 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.611003 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c526bac-1a47-4bac-8899-2d2c08d5c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.611930 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c526bac-1a47-4bac-8899-2d2c08d5c152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.612216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c526bac-1a47-4bac-8899-2d2c08d5c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.612492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c526bac-1a47-4bac-8899-2d2c08d5c152 admin admin] PATH_INFO: `/v3/projects/4c37c643a6314ede8d582b470e164dde/users/5862b075f9614b108ed73f825e5d49de/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.627762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c526bac-1a47-4bac-8899-2d2c08d5c152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c37c643a6314ede8d582b470e164dde, user_id=5862b075f9614b108ed73f825e5d49de, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.630432 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c526bac-1a47-4bac-8899-2d2c08d5c152 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.645285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1242/2450] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:09 2022] PUT /identity/v3/projects/4c37c643a6314ede8d582b470e164dde/users/5862b075f9614b108ed73f825e5d49de/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:33:09.657111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47ed3f-1ba2-45c9-ac43-23ed17848e38 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.657671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47ed3f-1ba2-45c9-ac43-23ed17848e38 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.657671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47ed3f-1ba2-45c9-ac43-23ed17848e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.685580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-7d47ed3f-1ba2-45c9-ac43-23ed17848e38 None None] MFA Rules not processed for user `5862b075f9614b108ed73f825e5d49de`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:09.686833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-7d47ed3f-1ba2-45c9-ac43-23ed17848e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:09.732943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:09.756527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1209/2451] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:33:09.760989 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c526bac-1a47-4bac-8899-2d2c08d5c152 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:09.774755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:09.824224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c526bac-1a47-4bac-8899-2d2c08d5c152 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.829483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f733c7-64d2-428d-8d78-0cd11eee5362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.830167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f733c7-64d2-428d-8d78-0cd11eee5362 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.830452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f733c7-64d2-428d-8d78-0cd11eee5362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.830732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f733c7-64d2-428d-8d78-0cd11eee5362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.831434 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f733c7-64d2-428d-8d78-0cd11eee5362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.833367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f733c7-64d2-428d-8d78-0cd11eee5362 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.858953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1243/2452] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:09 2022] POST /identity/v3/projects => generated 366 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:09.863066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47ed3f-1ba2-45c9-ac43-23ed17848e38 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:09.873797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47ed3f-1ba2-45c9-ac43-23ed17848e38 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.929377 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f0293-e308-46d0-88fa-9b69f5bd70a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.930044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f0293-e308-46d0-88fa-9b69f5bd70a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.930330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f0293-e308-46d0-88fa-9b69f5bd70a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.930605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f0293-e308-46d0-88fa-9b69f5bd70a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.931288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f0293-e308-46d0-88fa-9b69f5bd70a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.933331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f0293-e308-46d0-88fa-9b69f5bd70a5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.957067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1210/2453] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:09 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:09.961078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f733c7-64d2-428d-8d78-0cd11eee5362 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:09.972582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f733c7-64d2-428d-8d78-0cd11eee5362 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:09.977764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc618f0-1350-4eea-99d4-757593c52a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:09.978438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc618f0-1350-4eea-99d4-757593c52a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:09.978721 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc618f0-1350-4eea-99d4-757593c52a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:09.979029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc618f0-1350-4eea-99d4-757593c52a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:09.979802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc618f0-1350-4eea-99d4-757593c52a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:09.981415 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc618f0-1350-4eea-99d4-757593c52a38 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:09.992889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1244/2454] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:09 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:09.997399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f0293-e308-46d0-88fa-9b69f5bd70a5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:10.008299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f0293-e308-46d0-88fa-9b69f5bd70a5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:10.012998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c76d5e-6c57-4b30-98b2-db3a00bbd49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:10.013888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c76d5e-6c57-4b30-98b2-db3a00bbd49e admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:10.014417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c76d5e-6c57-4b30-98b2-db3a00bbd49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:10.015155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c76d5e-6c57-4b30-98b2-db3a00bbd49e admin admin] PATH_INFO: `/v3/projects/ba0a93baa608434198228461be48062b/users/f54ae0c6e3f14a99897a68fb8c1d0cf6/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:10.030697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c76d5e-6c57-4b30-98b2-db3a00bbd49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0a93baa608434198228461be48062b, user_id=f54ae0c6e3f14a99897a68fb8c1d0cf6, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:10.033709 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c76d5e-6c57-4b30-98b2-db3a00bbd49e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:10.049011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1211/2455] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:09 2022] PUT /identity/v3/projects/ba0a93baa608434198228461be48062b/users/f54ae0c6e3f14a99897a68fb8c1d0cf6/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:33:10.053637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc618f0-1350-4eea-99d4-757593c52a38 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:10.064680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc618f0-1350-4eea-99d4-757593c52a38 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:10.125801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc8001-cd1b-4602-99e2-f692d4a323c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:10.126472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc8001-cd1b-4602-99e2-f692d4a323c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:10.126757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc8001-cd1b-4602-99e2-f692d4a323c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:10.127048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc8001-cd1b-4602-99e2-f692d4a323c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:10.127795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc8001-cd1b-4602-99e2-f692d4a323c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:10.129391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc8001-cd1b-4602-99e2-f692d4a323c4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:10.139379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1245/2456] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:10 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:10.144121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c76d5e-6c57-4b30-98b2-db3a00bbd49e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:10.154365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c76d5e-6c57-4b30-98b2-db3a00bbd49e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:10.159143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870ed08-d115-49a3-80dd-5e0f7d62c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:10.160054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870ed08-d115-49a3-80dd-5e0f7d62c337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:10.160333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870ed08-d115-49a3-80dd-5e0f7d62c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:10.160608 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870ed08-d115-49a3-80dd-5e0f7d62c337 admin admin] PATH_INFO: `/v3/projects/ba0a93baa608434198228461be48062b/users/f54ae0c6e3f14a99897a68fb8c1d0cf6/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:10.162576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870ed08-d115-49a3-80dd-5e0f7d62c337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0a93baa608434198228461be48062b, user_id=f54ae0c6e3f14a99897a68fb8c1d0cf6, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:10.165266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870ed08-d115-49a3-80dd-5e0f7d62c337 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:10.176134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1212/2457] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:10 2022] PUT /identity/v3/projects/ba0a93baa608434198228461be48062b/users/f54ae0c6e3f14a99897a68fb8c1d0cf6/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:10.186607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65410ff-f746-410e-8461-a8294442d623 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:10.186904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65410ff-f746-410e-8461-a8294442d623 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:10.187217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65410ff-f746-410e-8461-a8294442d623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:10.220722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c65410ff-f746-410e-8461-a8294442d623 None None] MFA Rules not processed for user `f54ae0c6e3f14a99897a68fb8c1d0cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:10.221942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c65410ff-f746-410e-8461-a8294442d623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:10.290671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1246/2458] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:10.302114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870ed08-d115-49a3-80dd-5e0f7d62c337 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:10.303846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8870ed08-d115-49a3-80dd-5e0f7d62c337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:10.361322 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870ed08-d115-49a3-80dd-5e0f7d62c337 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:10.365028 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d02fe1-feea-4072-ab35-d3d80e411e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:10.365667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d02fe1-feea-4072-ab35-d3d80e411e86 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:10.365952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d02fe1-feea-4072-ab35-d3d80e411e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:10.366230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d02fe1-feea-4072-ab35-d3d80e411e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:10.376435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d02fe1-feea-4072-ab35-d3d80e411e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:10.377882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d02fe1-feea-4072-ab35-d3d80e411e86 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:10.387450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1213/2459] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:33:10.457744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65410ff-f746-410e-8461-a8294442d623 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:10.459289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c65410ff-f746-410e-8461-a8294442d623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:10.471921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65410ff-f746-410e-8461-a8294442d623 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:10.475590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e0a9e-44ee-4bfd-9cd6-fd32ac5fe196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:10.476250 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e0a9e-44ee-4bfd-9cd6-fd32ac5fe196 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:10.476792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e0a9e-44ee-4bfd-9cd6-fd32ac5fe196 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:10.477078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e0a9e-44ee-4bfd-9cd6-fd32ac5fe196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:10.482472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:10.539899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e0a9e-44ee-4bfd-9cd6-fd32ac5fe196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:10.541411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e0a9e-44ee-4bfd-9cd6-fd32ac5fe196 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:10.552050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1247/2460] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:11.861287 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9b83-d5d0-4c15-bc99-227d33d1e60e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:11.861851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9b83-d5d0-4c15-bc99-227d33d1e60e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:11.861851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9b83-d5d0-4c15-bc99-227d33d1e60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:11.880838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-be4a9b83-d5d0-4c15-bc99-227d33d1e60e None None] MFA Rules not processed for user `435fe25611c8486e81afae7e81e2aa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:11.882053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-be4a9b83-d5d0-4c15-bc99-227d33d1e60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:11.919058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:11.945754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1214/2461] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:12.270768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e0a9e-44ee-4bfd-9cd6-fd32ac5fe196 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:12.272236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-856e0a9e-44ee-4bfd-9cd6-fd32ac5fe196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:12.329459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e0a9e-44ee-4bfd-9cd6-fd32ac5fe196 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:12.333300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d1035-8fe6-4466-977b-e553fa32072e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:12.333949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d1035-8fe6-4466-977b-e553fa32072e service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:12.334234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d1035-8fe6-4466-977b-e553fa32072e service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:12.334512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d1035-8fe6-4466-977b-e553fa32072e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:12.336362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7e4d1035-8fe6-4466-977b-e553fa32072e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:12.347214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d1035-8fe6-4466-977b-e553fa32072e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:12.348701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d1035-8fe6-4466-977b-e553fa32072e service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:12.357486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1248/2462] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:12.669680 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9b83-d5d0-4c15-bc99-227d33d1e60e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:12.671186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-be4a9b83-d5d0-4c15-bc99-227d33d1e60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:12.744580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9b83-d5d0-4c15-bc99-227d33d1e60e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:12.749559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55268ba3-0d05-48ad-a890-487548c1ce20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:12.750208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55268ba3-0d05-48ad-a890-487548c1ce20 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:12.750493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55268ba3-0d05-48ad-a890-487548c1ce20 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:12.750770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55268ba3-0d05-48ad-a890-487548c1ce20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:12.752644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-55268ba3-0d05-48ad-a890-487548c1ce20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:12.765478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55268ba3-0d05-48ad-a890-487548c1ce20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:12.767048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55268ba3-0d05-48ad-a890-487548c1ce20 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:12.784517 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1215/2463] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:13.333427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d1035-8fe6-4466-977b-e553fa32072e service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:13.398765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d1035-8fe6-4466-977b-e553fa32072e service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:13.403842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:13.404787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:13.405075 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:13.405353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] PATH_INFO: `/v3/users/5862b075f9614b108ed73f825e5d49de` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:13.406586 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5862b075f9614b108ed73f825e5d49de)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:13.408610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:13.458792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5862b075f9614b108ed73f825e5d49de'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:13.459463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5862b075f9614b108ed73f825e5d49de'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:13.464033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:13.468796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5862b075f9614b108ed73f825e5d49de'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:13.469734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5862b075f9614b108ed73f825e5d49de'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:13.477500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5862b075f9614b108ed73f825e5d49de'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:13.494492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1249/2464] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:13 2022] DELETE /identity/v3/users/5862b075f9614b108ed73f825e5d49de => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:13.498958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963c43-8058-42f2-99b7-25394d866951 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:13.499465 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963c43-8058-42f2-99b7-25394d866951 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:13.499598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963c43-8058-42f2-99b7-25394d866951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:13.519333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e1963c43-8058-42f2-99b7-25394d866951 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:13.520586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e1963c43-8058-42f2-99b7-25394d866951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:13.579997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1216/2465] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:13.589568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:13.591027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:13.651065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276f87c-9f37-4ce1-b529-bbd7b708ec4f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:13.655797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824803c-2c89-4278-af15-234f2a720da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:13.656456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824803c-2c89-4278-af15-234f2a720da9 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:13.656735 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824803c-2c89-4278-af15-234f2a720da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:13.657010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824803c-2c89-4278-af15-234f2a720da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:13.668236 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824803c-2c89-4278-af15-234f2a720da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:13.669757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824803c-2c89-4278-af15-234f2a720da9 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:13.680502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1250/2466] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:14.031992 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963c43-8058-42f2-99b7-25394d866951 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:14.033445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e1963c43-8058-42f2-99b7-25394d866951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:14.050270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963c43-8058-42f2-99b7-25394d866951 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:14.056242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:14.057181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:14.057420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:14.057762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] PATH_INFO: `/v3/projects/4c37c643a6314ede8d582b470e164dde` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:14.060101 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c37c643a6314ede8d582b470e164dde)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:14.062941 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:14.120565 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c37c643a6314ede8d582b470e164dde', 'request_id': 'req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.128342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c37c643a6314ede8d582b470e164dde', 'request_id': 'req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.137037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c37c643a6314ede8d582b470e164dde', 'request_id': 'req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.143583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:14.151987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] The token cache is being invalidate because project 4c37c643a6314ede8d582b470e164dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:14.152893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.154099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.160558 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1217/2467] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:14 2022] DELETE /identity/v3/projects/4c37c643a6314ede8d582b470e164dde => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:14.164680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824803c-2c89-4278-af15-234f2a720da9 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:14.175323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824803c-2c89-4278-af15-234f2a720da9 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:14.238985 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:14.239899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:14.240188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:14.240476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] PATH_INFO: `/v3/users/f54ae0c6e3f14a99897a68fb8c1d0cf6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:14.241715 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54ae0c6e3f14a99897a68fb8c1d0cf6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:14.243720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:14.296073 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54ae0c6e3f14a99897a68fb8c1d0cf6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.297298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54ae0c6e3f14a99897a68fb8c1d0cf6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.304891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54ae0c6e3f14a99897a68fb8c1d0cf6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.305697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54ae0c6e3f14a99897a68fb8c1d0cf6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.317881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3f551d34-660d-4f28-9df7-2a17886f7ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54ae0c6e3f14a99897a68fb8c1d0cf6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.327587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:14.348639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1251/2468] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:14 2022] DELETE /identity/v3/users/f54ae0c6e3f14a99897a68fb8c1d0cf6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:14.649948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:14.651628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:14.671178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa5d5-6aee-4d68-bfc2-36e85eb81bec admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:14.764545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:14.765440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:14.765726 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:14.766002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] PATH_INFO: `/v3/projects/ba0a93baa608434198228461be48062b` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:14.767493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0a93baa608434198228461be48062b)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:14.769853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:14.824633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0a93baa608434198228461be48062b', 'request_id': 'req-15909a54-1457-4541-9463-4b77402732cf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.831713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0a93baa608434198228461be48062b', 'request_id': 'req-15909a54-1457-4541-9463-4b77402732cf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.839832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0a93baa608434198228461be48062b', 'request_id': 'req-15909a54-1457-4541-9463-4b77402732cf'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.851368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] The token cache is being invalidate because project ba0a93baa608434198228461be48062b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:14.851959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.852640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-15909a54-1457-4541-9463-4b77402732cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:14.854420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1218/2469] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:14 2022] DELETE /identity/v3/projects/ba0a93baa608434198228461be48062b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:14.860267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee0efe-f4a5-4bed-ab7f-6b42bf4646f0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:14.860584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee0efe-f4a5-4bed-ab7f-6b42bf4646f0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:14.860817 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee0efe-f4a5-4bed-ab7f-6b42bf4646f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:14.883677 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8aee0efe-f4a5-4bed-ab7f-6b42bf4646f0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:14.886504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8aee0efe-f4a5-4bed-ab7f-6b42bf4646f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:14.965810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1252/2470] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:14.975546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c611706-32fb-40e0-bacc-6369435122f1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:14.976208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c611706-32fb-40e0-bacc-6369435122f1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:14.976791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c611706-32fb-40e0-bacc-6369435122f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:14.999751 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-2c611706-32fb-40e0-bacc-6369435122f1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:15.001229 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2c611706-32fb-40e0-bacc-6369435122f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:15.011604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1219/2471] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:15.015727 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee0efe-f4a5-4bed-ab7f-6b42bf4646f0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.031034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee0efe-f4a5-4bed-ab7f-6b42bf4646f0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.044167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df1547-c448-410b-94a8-98367c851e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.045987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df1547-c448-410b-94a8-98367c851e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.046571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df1547-c448-410b-94a8-98367c851e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.047048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df1547-c448-410b-94a8-98367c851e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.048567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df1547-c448-410b-94a8-98367c851e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:15.048886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df1547-c448-410b-94a8-98367c851e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.050597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df1547-c448-410b-94a8-98367c851e53 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.068625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1253/2472] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:33:15.069816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c611706-32fb-40e0-bacc-6369435122f1 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.080830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c611706-32fb-40e0-bacc-6369435122f1 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.085854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f00cca-d482-4e31-bc29-7a4cb2da41eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.086890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f00cca-d482-4e31-bc29-7a4cb2da41eb admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.087306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f00cca-d482-4e31-bc29-7a4cb2da41eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.087765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f00cca-d482-4e31-bc29-7a4cb2da41eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.088532 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f00cca-d482-4e31-bc29-7a4cb2da41eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.090590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f00cca-d482-4e31-bc29-7a4cb2da41eb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.122923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1220/2473] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:15 2022] POST /identity/v3/projects => generated 368 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:15.128566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df1547-c448-410b-94a8-98367c851e53 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.139851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df1547-c448-410b-94a8-98367c851e53 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.222712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed81bd-8b31-47bc-b3a9-636d26915463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.223745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed81bd-8b31-47bc-b3a9-636d26915463 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.224170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed81bd-8b31-47bc-b3a9-636d26915463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.224595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed81bd-8b31-47bc-b3a9-636d26915463 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.225681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed81bd-8b31-47bc-b3a9-636d26915463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.228348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed81bd-8b31-47bc-b3a9-636d26915463 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.258116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1254/2474] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:15 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:15.263008 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f00cca-d482-4e31-bc29-7a4cb2da41eb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.276713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f00cca-d482-4e31-bc29-7a4cb2da41eb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.283393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02168cb2-ba36-4f86-ac0b-c6d6886b8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.284099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02168cb2-ba36-4f86-ac0b-c6d6886b8522 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.284429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02168cb2-ba36-4f86-ac0b-c6d6886b8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.284660 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02168cb2-ba36-4f86-ac0b-c6d6886b8522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.285453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02168cb2-ba36-4f86-ac0b-c6d6886b8522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.287226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02168cb2-ba36-4f86-ac0b-c6d6886b8522 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.299946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1221/2475] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:15 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:33:15.304302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed81bd-8b31-47bc-b3a9-636d26915463 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.319402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed81bd-8b31-47bc-b3a9-636d26915463 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.328320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acce63-1b9e-44c2-8c13-25acb6b7b423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.329172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acce63-1b9e-44c2-8c13-25acb6b7b423 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.329461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acce63-1b9e-44c2-8c13-25acb6b7b423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.330368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acce63-1b9e-44c2-8c13-25acb6b7b423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.331158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acce63-1b9e-44c2-8c13-25acb6b7b423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.332897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acce63-1b9e-44c2-8c13-25acb6b7b423 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.348040 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1255/2476] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:15 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:15.353294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02168cb2-ba36-4f86-ac0b-c6d6886b8522 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.365106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02168cb2-ba36-4f86-ac0b-c6d6886b8522 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.370093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcc6ad-91cb-4529-8cac-88c68103bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.371093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcc6ad-91cb-4529-8cac-88c68103bd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.371447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcc6ad-91cb-4529-8cac-88c68103bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.371828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcc6ad-91cb-4529-8cac-88c68103bd7e admin admin] PATH_INFO: `/v3/projects/658bd7cbac174e52a3d30323a26556fb/users/5da779c80f3b434e9e436d2b1bcdd6d9/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.391231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcc6ad-91cb-4529-8cac-88c68103bd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=658bd7cbac174e52a3d30323a26556fb, user_id=5da779c80f3b434e9e436d2b1bcdd6d9, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.393977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dcc6ad-91cb-4529-8cac-88c68103bd7e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.410741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1222/2477] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:15 2022] PUT /identity/v3/projects/658bd7cbac174e52a3d30323a26556fb/users/5da779c80f3b434e9e436d2b1bcdd6d9/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:15.420803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a0c48-6a7e-4a96-99cd-3211875a4f90 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.421353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a0c48-6a7e-4a96-99cd-3211875a4f90 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.422608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a0c48-6a7e-4a96-99cd-3211875a4f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.458873 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-042a0c48-6a7e-4a96-99cd-3211875a4f90 None None] MFA Rules not processed for user `5da779c80f3b434e9e436d2b1bcdd6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:15.460448 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-042a0c48-6a7e-4a96-99cd-3211875a4f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:15.524601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:15.568865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1256/2478] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:15.570421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcc6ad-91cb-4529-8cac-88c68103bd7e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.604752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:15.657847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dcc6ad-91cb-4529-8cac-88c68103bd7e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.663508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c654a-f99f-4d97-91fe-85998e693eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.664419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c654a-f99f-4d97-91fe-85998e693eda admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.664812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c654a-f99f-4d97-91fe-85998e693eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.665200 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c654a-f99f-4d97-91fe-85998e693eda admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.666830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c654a-f99f-4d97-91fe-85998e693eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.669057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c654a-f99f-4d97-91fe-85998e693eda admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.707282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1223/2479] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:15 2022] POST /identity/v3/projects => generated 370 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:15.709749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a0c48-6a7e-4a96-99cd-3211875a4f90 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.724436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a0c48-6a7e-4a96-99cd-3211875a4f90 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.835012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e09fe6-ad9f-4750-b2ae-4c296a651151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.836026 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e09fe6-ad9f-4750-b2ae-4c296a651151 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.836420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e09fe6-ad9f-4750-b2ae-4c296a651151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.836808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e09fe6-ad9f-4750-b2ae-4c296a651151 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.837633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e09fe6-ad9f-4750-b2ae-4c296a651151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.839781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e09fe6-ad9f-4750-b2ae-4c296a651151 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.866712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1257/2480] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:15 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:15.868331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c654a-f99f-4d97-91fe-85998e693eda admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.879975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c654a-f99f-4d97-91fe-85998e693eda admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.887068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfc075-430e-4901-95fa-d90f490a552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.887830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfc075-430e-4901-95fa-d90f490a552e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.888061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfc075-430e-4901-95fa-d90f490a552e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.888337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfc075-430e-4901-95fa-d90f490a552e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.889110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfc075-430e-4901-95fa-d90f490a552e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.890741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfc075-430e-4901-95fa-d90f490a552e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.909530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1224/2481] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:15 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:15.913505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e09fe6-ad9f-4750-b2ae-4c296a651151 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.924267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e09fe6-ad9f-4750-b2ae-4c296a651151 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:15.928956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84efdf3-816c-45e3-bab2-46f58abcd82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:15.929844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84efdf3-816c-45e3-bab2-46f58abcd82e admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:15.930122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84efdf3-816c-45e3-bab2-46f58abcd82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:15.930399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84efdf3-816c-45e3-bab2-46f58abcd82e admin admin] PATH_INFO: `/v3/projects/8fc7b2619a84461884f0d587fb23497b/users/4f167b409774477eb06c16f62163b13e/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:15.947291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84efdf3-816c-45e3-bab2-46f58abcd82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc7b2619a84461884f0d587fb23497b, user_id=4f167b409774477eb06c16f62163b13e, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:15.950038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84efdf3-816c-45e3-bab2-46f58abcd82e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:15.965585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1258/2482] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:15 2022] PUT /identity/v3/projects/8fc7b2619a84461884f0d587fb23497b/users/4f167b409774477eb06c16f62163b13e/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:33:15.972169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfc075-430e-4901-95fa-d90f490a552e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:15.985577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfc075-430e-4901-95fa-d90f490a552e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:16.053263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c3a8-0c42-40f4-84a0-c2ec90d1f7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:16.054115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c3a8-0c42-40f4-84a0-c2ec90d1f7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:16.054511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c3a8-0c42-40f4-84a0-c2ec90d1f7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:16.054916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c3a8-0c42-40f4-84a0-c2ec90d1f7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:16.055815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c3a8-0c42-40f4-84a0-c2ec90d1f7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:16.057689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c3a8-0c42-40f4-84a0-c2ec90d1f7e7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:16.072351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1225/2483] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:15 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:33:16.073857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84efdf3-816c-45e3-bab2-46f58abcd82e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:16.084706 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84efdf3-816c-45e3-bab2-46f58abcd82e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:16.089561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e7e11-347e-47f4-9370-73952d95a33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:16.090447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e7e11-347e-47f4-9370-73952d95a33c admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:16.090739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e7e11-347e-47f4-9370-73952d95a33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:16.091016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e7e11-347e-47f4-9370-73952d95a33c admin admin] PATH_INFO: `/v3/projects/8fc7b2619a84461884f0d587fb23497b/users/4f167b409774477eb06c16f62163b13e/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:16.093606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e7e11-347e-47f4-9370-73952d95a33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc7b2619a84461884f0d587fb23497b, user_id=4f167b409774477eb06c16f62163b13e, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:16.096322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e7e11-347e-47f4-9370-73952d95a33c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:16.110005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1259/2484] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:16 2022] PUT /identity/v3/projects/8fc7b2619a84461884f0d587fb23497b/users/4f167b409774477eb06c16f62163b13e/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:33:16.120754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804140c-dac6-4151-8c9f-56bbdd4fed2b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:16.121073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804140c-dac6-4151-8c9f-56bbdd4fed2b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:16.121350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804140c-dac6-4151-8c9f-56bbdd4fed2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:16.149924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a804140c-dac6-4151-8c9f-56bbdd4fed2b None None] MFA Rules not processed for user `4f167b409774477eb06c16f62163b13e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:16.151053 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a804140c-dac6-4151-8c9f-56bbdd4fed2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:16.228940 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1226/2485] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:33:16.241114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e7e11-347e-47f4-9370-73952d95a33c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:16.242865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c27e7e11-347e-47f4-9370-73952d95a33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:16.306651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e7e11-347e-47f4-9370-73952d95a33c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:16.310555 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86365627-2e0c-4ef4-b715-5249d610b713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:16.311230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86365627-2e0c-4ef4-b715-5249d610b713 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:16.311517 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86365627-2e0c-4ef4-b715-5249d610b713 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:16.311828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86365627-2e0c-4ef4-b715-5249d610b713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:16.323058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86365627-2e0c-4ef4-b715-5249d610b713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:16.324580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86365627-2e0c-4ef4-b715-5249d610b713 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:16.336164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1260/2486] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:16.382586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804140c-dac6-4151-8c9f-56bbdd4fed2b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:16.384100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a804140c-dac6-4151-8c9f-56bbdd4fed2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:16.400311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804140c-dac6-4151-8c9f-56bbdd4fed2b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:16.405722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3df1d-6417-46a0-9b68-aa8c5b1afb1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:16.406596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3df1d-6417-46a0-9b68-aa8c5b1afb1a service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:16.406880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3df1d-6417-46a0-9b68-aa8c5b1afb1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:16.407154 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3df1d-6417-46a0-9b68-aa8c5b1afb1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:16.421728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:16.472410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3df1d-6417-46a0-9b68-aa8c5b1afb1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:16.474030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3df1d-6417-46a0-9b68-aa8c5b1afb1a service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:16.484331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1227/2487] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:19.821120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86365627-2e0c-4ef4-b715-5249d610b713 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:19.865030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:19.883308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86365627-2e0c-4ef4-b715-5249d610b713 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:19.887948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:19.889346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:19.889632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:19.889904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] PATH_INFO: `/v3/users/5da779c80f3b434e9e436d2b1bcdd6d9` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:19.891110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da779c80f3b434e9e436d2b1bcdd6d9)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:19.893084 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:19.940692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da779c80f3b434e9e436d2b1bcdd6d9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:19.941785 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da779c80f3b434e9e436d2b1bcdd6d9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:19.950167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da779c80f3b434e9e436d2b1bcdd6d9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:19.950861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da779c80f3b434e9e436d2b1bcdd6d9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:19.959616 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da779c80f3b434e9e436d2b1bcdd6d9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:19.979905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1261/2488] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:19 2022] DELETE /identity/v3/users/5da779c80f3b434e9e436d2b1bcdd6d9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:19.984447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65920677-93fc-4fa1-aa77-4274b3e8d02a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:19.984930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65920677-93fc-4fa1-aa77-4274b3e8d02a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:19.985153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65920677-93fc-4fa1-aa77-4274b3e8d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:20.002312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-65920677-93fc-4fa1-aa77-4274b3e8d02a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:20.003533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-65920677-93fc-4fa1-aa77-4274b3e8d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:20.075700 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1228/2489] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:20.089081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:20.090574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:20.093387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65920677-93fc-4fa1-aa77-4274b3e8d02a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:20.094954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-65920677-93fc-4fa1-aa77-4274b3e8d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:20.193816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4110fac-5da7-4f53-9322-fe63ce87b284 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:20.201374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:20.202160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65920677-93fc-4fa1-aa77-4274b3e8d02a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:20.202427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:20.203010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:20.203521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:20.206086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf75d5-7fc6-42d2-a7d7-cd9d6d4aa3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:20.206261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:20.206862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf75d5-7fc6-42d2-a7d7-cd9d6d4aa3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:20.207147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf75d5-7fc6-42d2-a7d7-cd9d6d4aa3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:20.207422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf75d5-7fc6-42d2-a7d7-cd9d6d4aa3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:20.219486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf75d5-7fc6-42d2-a7d7-cd9d6d4aa3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:20.221125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf75d5-7fc6-42d2-a7d7-cd9d6d4aa3d8 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:20.228458 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:20.230229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:20.242298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1262/2490] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:20.243032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1229/2491] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:20.594038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:20.595431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:20.608952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856244a-75e4-450e-bb4b-2f0f72857552 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:20.613651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:20.614515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:20.614797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:20.615302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] PATH_INFO: `/v3/projects/658bd7cbac174e52a3d30323a26556fb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:20.616289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=658bd7cbac174e52a3d30323a26556fb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:20.618209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:20.659922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:20.668343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658bd7cbac174e52a3d30323a26556fb', 'request_id': 'req-69455c42-62e7-436c-a3e5-ecbfc99b99f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.675124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658bd7cbac174e52a3d30323a26556fb', 'request_id': 'req-69455c42-62e7-436c-a3e5-ecbfc99b99f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.682316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658bd7cbac174e52a3d30323a26556fb', 'request_id': 'req-69455c42-62e7-436c-a3e5-ecbfc99b99f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.693166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] The token cache is being invalidate because project 658bd7cbac174e52a3d30323a26556fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:20.693457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.694121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.695707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1263/2492] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:20 2022] DELETE /identity/v3/projects/658bd7cbac174e52a3d30323a26556fb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:20.699833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf75d5-7fc6-42d2-a7d7-cd9d6d4aa3d8 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:20.710580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf75d5-7fc6-42d2-a7d7-cd9d6d4aa3d8 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:20.766796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:20.767712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:20.767997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:20.768274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] PATH_INFO: `/v3/users/4f167b409774477eb06c16f62163b13e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:20.769486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f167b409774477eb06c16f62163b13e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:20.771420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:20.772978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:20.817911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f167b409774477eb06c16f62163b13e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.818564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f167b409774477eb06c16f62163b13e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.830870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f167b409774477eb06c16f62163b13e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.837911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f167b409774477eb06c16f62163b13e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.838541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-93f11dc0-c375-44d6-95c8-f621bb76b8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f167b409774477eb06c16f62163b13e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:20.852170 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1230/2493] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:20 2022] DELETE /identity/v3/users/4f167b409774477eb06c16f62163b13e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:21.125674 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:21.127169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:21.141267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69455c42-62e7-436c-a3e5-ecbfc99b99f4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:21.200905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:21.202386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.202664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.202940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] PATH_INFO: `/v3/projects/8fc7b2619a84461884f0d587fb23497b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.204132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc7b2619a84461884f0d587fb23497b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:21.206024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:21.254634 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc7b2619a84461884f0d587fb23497b', 'request_id': 'req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:21.260830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc7b2619a84461884f0d587fb23497b', 'request_id': 'req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:21.270475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc7b2619a84461884f0d587fb23497b', 'request_id': 'req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:21.281978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] The token cache is being invalidate because project 8fc7b2619a84461884f0d587fb23497b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:21.282332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:21.282992 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cda9f6da-fc39-48a9-bcf5-d9ff130154b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:21.284620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1264/2494] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:21 2022] DELETE /identity/v3/projects/8fc7b2619a84461884f0d587fb23497b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:21.289643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa01158-a6cd-417a-a73a-0012d7ddb3e3 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.290119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa01158-a6cd-417a-a73a-0012d7ddb3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.290233 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa01158-a6cd-417a-a73a-0012d7ddb3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.308530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ffa01158-a6cd-417a-a73a-0012d7ddb3e3 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:21.309741 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ffa01158-a6cd-417a-a73a-0012d7ddb3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:21.371527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1231/2495] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:21.380742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912f21-001f-4e89-bdd5-2b2b6442a0a0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.381146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912f21-001f-4e89-bdd5-2b2b6442a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.381482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912f21-001f-4e89-bdd5-2b2b6442a0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.400481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-00912f21-001f-4e89-bdd5-2b2b6442a0a0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:21.401764 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-00912f21-001f-4e89-bdd5-2b2b6442a0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:21.411522 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1265/2496] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:21.415925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa01158-a6cd-417a-a73a-0012d7ddb3e3 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:21.426218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa01158-a6cd-417a-a73a-0012d7ddb3e3 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:21.431156 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39c32-c501-4aa3-9a5f-93e7cb60089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:21.431837 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39c32-c501-4aa3-9a5f-93e7cb60089b admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.432125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39c32-c501-4aa3-9a5f-93e7cb60089b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.432404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39c32-c501-4aa3-9a5f-93e7cb60089b admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.433136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39c32-c501-4aa3-9a5f-93e7cb60089b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:21.433444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39c32-c501-4aa3-9a5f-93e7cb60089b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:21.435072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39c32-c501-4aa3-9a5f-93e7cb60089b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:21.447323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1232/2497] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:33:21.451647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00912f21-001f-4e89-bdd5-2b2b6442a0a0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:21.461072 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00912f21-001f-4e89-bdd5-2b2b6442a0a0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:21.465883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314da2c-d029-4ba6-809f-238ea2fc1b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:21.466527 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314da2c-d029-4ba6-809f-238ea2fc1b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.466863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314da2c-d029-4ba6-809f-238ea2fc1b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.467148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314da2c-d029-4ba6-809f-238ea2fc1b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.467884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314da2c-d029-4ba6-809f-238ea2fc1b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:21.469789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314da2c-d029-4ba6-809f-238ea2fc1b5d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:21.495465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1266/2498] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:21 2022] POST /identity/v3/projects => generated 380 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:21.500221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39c32-c501-4aa3-9a5f-93e7cb60089b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:21.510263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39c32-c501-4aa3-9a5f-93e7cb60089b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:21.567346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b976a2c-da5a-4a6d-b4bb-80e7d5fbb56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:21.568057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b976a2c-da5a-4a6d-b4bb-80e7d5fbb56a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.568342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b976a2c-da5a-4a6d-b4bb-80e7d5fbb56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.568621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b976a2c-da5a-4a6d-b4bb-80e7d5fbb56a admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.569320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b976a2c-da5a-4a6d-b4bb-80e7d5fbb56a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:21.571251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b976a2c-da5a-4a6d-b4bb-80e7d5fbb56a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:21.581439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:21.592243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1233/2499] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:21 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:21.596315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314da2c-d029-4ba6-809f-238ea2fc1b5d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:21.606897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314da2c-d029-4ba6-809f-238ea2fc1b5d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:21.612055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1cc7a-d68e-477e-97ac-3441a8efa823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:21.612703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1cc7a-d68e-477e-97ac-3441a8efa823 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.613062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1cc7a-d68e-477e-97ac-3441a8efa823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.613338 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1cc7a-d68e-477e-97ac-3441a8efa823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.614063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1cc7a-d68e-477e-97ac-3441a8efa823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:21.615845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1cc7a-d68e-477e-97ac-3441a8efa823 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:21.630012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1267/2500] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:21 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:21.633861 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b976a2c-da5a-4a6d-b4bb-80e7d5fbb56a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:21.645417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b976a2c-da5a-4a6d-b4bb-80e7d5fbb56a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:21.650213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaf315-f26e-4f85-ba2c-540eacc63c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:21.650865 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaf315-f26e-4f85-ba2c-540eacc63c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.651151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaf315-f26e-4f85-ba2c-540eacc63c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.651432 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaf315-f26e-4f85-ba2c-540eacc63c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.652198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaf315-f26e-4f85-ba2c-540eacc63c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:21.653819 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaf315-f26e-4f85-ba2c-540eacc63c82 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:21.665085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1234/2501] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:21 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:21.669291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1cc7a-d68e-477e-97ac-3441a8efa823 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:21.680301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1cc7a-d68e-477e-97ac-3441a8efa823 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:21.684929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a805-f8c2-40fd-9cdb-ccde206abebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:21.685823 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a805-f8c2-40fd-9cdb-ccde206abebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.686098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a805-f8c2-40fd-9cdb-ccde206abebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.686368 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a805-f8c2-40fd-9cdb-ccde206abebf admin admin] PATH_INFO: `/v3/projects/c159339920a0453eaf6cab55439d546a/users/deea78315612486782ff47b22cf6634d/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.700791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72a805-f8c2-40fd-9cdb-ccde206abebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c159339920a0453eaf6cab55439d546a, user_id=deea78315612486782ff47b22cf6634d, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:21.703539 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72a805-f8c2-40fd-9cdb-ccde206abebf admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:21.706660 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:21.720328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1268/2502] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:21 2022] PUT /identity/v3/projects/c159339920a0453eaf6cab55439d546a/users/deea78315612486782ff47b22cf6634d/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:33:21.730697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad911c57-47b6-4854-98c7-df53c33744e7 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.730988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad911c57-47b6-4854-98c7-df53c33744e7 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.731267 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad911c57-47b6-4854-98c7-df53c33744e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.757880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ad911c57-47b6-4854-98c7-df53c33744e7 None None] MFA Rules not processed for user `deea78315612486782ff47b22cf6634d`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:21.759095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ad911c57-47b6-4854-98c7-df53c33744e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:21.826370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1235/2503] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:21.830865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a805-f8c2-40fd-9cdb-ccde206abebf admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:21.894376 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a805-f8c2-40fd-9cdb-ccde206abebf admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:21.898927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fd42e-4e93-47ce-bb14-9423a9f181b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:21.899599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fd42e-4e93-47ce-bb14-9423a9f181b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:21.899889 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fd42e-4e93-47ce-bb14-9423a9f181b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:21.900198 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fd42e-4e93-47ce-bb14-9423a9f181b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:21.900858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fd42e-4e93-47ce-bb14-9423a9f181b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:21.902747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fd42e-4e93-47ce-bb14-9423a9f181b3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:21.928481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1269/2504] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:21 2022] POST /identity/v3/projects => generated 382 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:21.932904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad911c57-47b6-4854-98c7-df53c33744e7 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:21.943581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad911c57-47b6-4854-98c7-df53c33744e7 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:22.003686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f1689-7976-4355-bf30-c5c5c4a1f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:22.004363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1689-7976-4355-bf30-c5c5c4a1f997 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.004650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1689-7976-4355-bf30-c5c5c4a1f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.004929 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1689-7976-4355-bf30-c5c5c4a1f997 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.005631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f1689-7976-4355-bf30-c5c5c4a1f997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:22.007568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f1689-7976-4355-bf30-c5c5c4a1f997 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:22.026993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1236/2505] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:21 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:33:22.031687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fd42e-4e93-47ce-bb14-9423a9f181b3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:22.042926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fd42e-4e93-47ce-bb14-9423a9f181b3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:22.048082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d70c20-fcb2-4275-aa34-c4e4e63dc6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:22.048731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d70c20-fcb2-4275-aa34-c4e4e63dc6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.049014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d70c20-fcb2-4275-aa34-c4e4e63dc6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.049289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d70c20-fcb2-4275-aa34-c4e4e63dc6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.050010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d70c20-fcb2-4275-aa34-c4e4e63dc6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:22.051642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d70c20-fcb2-4275-aa34-c4e4e63dc6f6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:22.062237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1270/2506] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:22 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:22.066742 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f1689-7976-4355-bf30-c5c5c4a1f997 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:22.077422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f1689-7976-4355-bf30-c5c5c4a1f997 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:22.082272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7a89b-3f83-4299-9af8-4608927ed354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:22.083148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7a89b-3f83-4299-9af8-4608927ed354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.083431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7a89b-3f83-4299-9af8-4608927ed354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.083746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7a89b-3f83-4299-9af8-4608927ed354 admin admin] PATH_INFO: `/v3/projects/bfbfe3ff04c84e5990992cf5a23fd2c7/users/b8e7ba6bec634e5eaceedd3eda77be55/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.099312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7a89b-3f83-4299-9af8-4608927ed354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbfe3ff04c84e5990992cf5a23fd2c7, user_id=b8e7ba6bec634e5eaceedd3eda77be55, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:22.102489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7a89b-3f83-4299-9af8-4608927ed354 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:22.116804 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1237/2507] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:22 2022] PUT /identity/v3/projects/bfbfe3ff04c84e5990992cf5a23fd2c7/users/b8e7ba6bec634e5eaceedd3eda77be55/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:22.120621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d70c20-fcb2-4275-aa34-c4e4e63dc6f6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:22.131944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d70c20-fcb2-4275-aa34-c4e4e63dc6f6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:22.199120 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b2524-6c4e-47a5-a75f-8421efb885da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:22.199830 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b2524-6c4e-47a5-a75f-8421efb885da admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.200114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b2524-6c4e-47a5-a75f-8421efb885da admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.200389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b2524-6c4e-47a5-a75f-8421efb885da admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.201675 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b2524-6c4e-47a5-a75f-8421efb885da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:22.203311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b2524-6c4e-47a5-a75f-8421efb885da admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:22.214552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1271/2508] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:22 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:33:22.222275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7a89b-3f83-4299-9af8-4608927ed354 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:22.234653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7a89b-3f83-4299-9af8-4608927ed354 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:22.239578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c715da-ba67-46c7-a930-52654b370bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:22.240461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c715da-ba67-46c7-a930-52654b370bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.240737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c715da-ba67-46c7-a930-52654b370bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.241008 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c715da-ba67-46c7-a930-52654b370bcf admin admin] PATH_INFO: `/v3/projects/bfbfe3ff04c84e5990992cf5a23fd2c7/users/b8e7ba6bec634e5eaceedd3eda77be55/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.242986 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c715da-ba67-46c7-a930-52654b370bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbfe3ff04c84e5990992cf5a23fd2c7, user_id=b8e7ba6bec634e5eaceedd3eda77be55, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:22.245675 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c715da-ba67-46c7-a930-52654b370bcf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:22.256346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1238/2509] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:22 2022] PUT /identity/v3/projects/bfbfe3ff04c84e5990992cf5a23fd2c7/users/b8e7ba6bec634e5eaceedd3eda77be55/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:22.268139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6a8c-4f70-4b4b-b302-42a0f20b42cd None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.268431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6a8c-4f70-4b4b-b302-42a0f20b42cd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.268710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e6a8c-4f70-4b4b-b302-42a0f20b42cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.296015 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-119e6a8c-4f70-4b4b-b302-42a0f20b42cd None None] MFA Rules not processed for user `b8e7ba6bec634e5eaceedd3eda77be55`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:22.297297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-119e6a8c-4f70-4b4b-b302-42a0f20b42cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:22.347334 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:22.365894 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1272/2510] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:22.378515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c715da-ba67-46c7-a930-52654b370bcf admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:22.380318 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-52c715da-ba67-46c7-a930-52654b370bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:22.413900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:22.444078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c715da-ba67-46c7-a930-52654b370bcf admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:22.447857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54acab-f9c3-4853-a027-d0fc8d42372c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:22.448506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54acab-f9c3-4853-a027-d0fc8d42372c service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.448790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54acab-f9c3-4853-a027-d0fc8d42372c service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.449091 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54acab-f9c3-4853-a027-d0fc8d42372c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.459836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54acab-f9c3-4853-a027-d0fc8d42372c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:22.461296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54acab-f9c3-4853-a027-d0fc8d42372c service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:22.471816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1239/2511] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:22.803285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6a8c-4f70-4b4b-b302-42a0f20b42cd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:22.813085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e6a8c-4f70-4b4b-b302-42a0f20b42cd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:22.817759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3f2d-4e8f-43e0-9d2a-c55637c27eeb tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e7ba6bec634e5eaceedd3eda77be55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfbfe3ff04c84e5990992cf5a23fd2c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:22.818411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3f2d-4e8f-43e0-9d2a-c55637c27eeb tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.818695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3f2d-4e8f-43e0-9d2a-c55637c27eeb tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.819479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3f2d-4e8f-43e0-9d2a-c55637c27eeb tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.820254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e3f2d-4e8f-43e0-9d2a-c55637c27eeb tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:22.820254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e3f2d-4e8f-43e0-9d2a-c55637c27eeb tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:22.821612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e3f2d-4e8f-43e0-9d2a-c55637c27eeb tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:22.833605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1273/2512] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:33:22.838119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54acab-f9c3-4853-a027-d0fc8d42372c service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:22.848337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54acab-f9c3-4853-a027-d0fc8d42372c service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:22.853248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d2daf-1e87-4e84-a735-a277277be816 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e7ba6bec634e5eaceedd3eda77be55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfbfe3ff04c84e5990992cf5a23fd2c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:22.853903 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d2daf-1e87-4e84-a735-a277277be816 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.854188 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d2daf-1e87-4e84-a735-a277277be816 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.854463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d2daf-1e87-4e84-a735-a277277be816 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.855335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d2daf-1e87-4e84-a735-a277277be816 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:22.857881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d2daf-1e87-4e84-a735-a277277be816 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:22.890278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1240/2513] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:22 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:22.891931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3f2d-4e8f-43e0-9d2a-c55637c27eeb tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:22.902247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3f2d-4e8f-43e0-9d2a-c55637c27eeb tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:22.981584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e7ba6bec634e5eaceedd3eda77be55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfbfe3ff04c84e5990992cf5a23fd2c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:22.984527 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:22.985033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:22.985457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:22.986710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:22.987157 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:22.989080 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:23.005819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1274/2514] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:33:23.047525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d2daf-1e87-4e84-a735-a277277be816 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:23.058853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d2daf-1e87-4e84-a735-a277277be816 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:23.064810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e7ba6bec634e5eaceedd3eda77be55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfbfe3ff04c84e5990992cf5a23fd2c7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:23.065792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:23.066151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:23.066478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] PATH_INFO: `/v3/projects/a1bfa96a34ab4a9a931980da81d0b281` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:23.067815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a1bfa96a34ab4a9a931980da81d0b281)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:23.069845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:23.141816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bfa96a34ab4a9a931980da81d0b281', 'request_id': 'req-c148ca20-a15f-44e2-836a-41066d672537'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.149185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bfa96a34ab4a9a931980da81d0b281', 'request_id': 'req-c148ca20-a15f-44e2-836a-41066d672537'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.159494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bfa96a34ab4a9a931980da81d0b281', 'request_id': 'req-c148ca20-a15f-44e2-836a-41066d672537'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.176485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] The token cache is being invalidate because project a1bfa96a34ab4a9a931980da81d0b281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:23.177057 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.178052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.180594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1241/2515] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:23 2022] DELETE /identity/v3/projects/a1bfa96a34ab4a9a931980da81d0b281 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:23.418455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:23.420974 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:23.489846 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e8bc5-dcfa-4c82-99cf-eafbb71829f1 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:23.554493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:23.555391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:23.555720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:23.556023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] PATH_INFO: `/v3/users/deea78315612486782ff47b22cf6634d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:23.557314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deea78315612486782ff47b22cf6634d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:23.559293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:23.585437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:23.622605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deea78315612486782ff47b22cf6634d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.624090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deea78315612486782ff47b22cf6634d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.632036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deea78315612486782ff47b22cf6634d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.632831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deea78315612486782ff47b22cf6634d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.642114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-fb76540c-47c1-4593-badb-bbce32bc7206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deea78315612486782ff47b22cf6634d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:23.662776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:23.664306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:23.666708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1275/2516] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:23 2022] DELETE /identity/v3/users/deea78315612486782ff47b22cf6634d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:23.672154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d67e-7033-4f9b-8c2d-741d9c405e78 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:23.674287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d67e-7033-4f9b-8c2d-741d9c405e78 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:23.674287 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d67e-7033-4f9b-8c2d-741d9c405e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:23.693372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4301d67e-7033-4f9b-8c2d-741d9c405e78 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:23.694584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4301d67e-7033-4f9b-8c2d-741d9c405e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:23.758444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148ca20-a15f-44e2-836a-41066d672537 tempest-VolumeQuotaClassesTest-1804039323 tempest-VolumeQuotaClassesTest-1804039323-project-admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:23.764282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1276/2517] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:23.773964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301d67e-7033-4f9b-8c2d-741d9c405e78 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:23.775352 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4301d67e-7033-4f9b-8c2d-741d9c405e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:23.792320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:23.838750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f51d7-488d-4339-981a-4a530b7fbb33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:23.839629 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f51d7-488d-4339-981a-4a530b7fbb33 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:23.840012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f51d7-488d-4339-981a-4a530b7fbb33 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:23.840409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f51d7-488d-4339-981a-4a530b7fbb33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:23.841746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301d67e-7033-4f9b-8c2d-741d9c405e78 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:23.842995 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ad8f51d7-488d-4339-981a-4a530b7fbb33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:23.846101 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2e80a-bb9c-4284-99f8-df5de01075bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:23.846832 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2e80a-bb9c-4284-99f8-df5de01075bd service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:23.847206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2e80a-bb9c-4284-99f8-df5de01075bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:23.847754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2e80a-bb9c-4284-99f8-df5de01075bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:23.856825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f51d7-488d-4339-981a-4a530b7fbb33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:23.858470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2e80a-bb9c-4284-99f8-df5de01075bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:23.858602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f51d7-488d-4339-981a-4a530b7fbb33 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:23.860114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2e80a-bb9c-4284-99f8-df5de01075bd service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:23.871378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1277/2518] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:23.872481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1242/2519] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:33:24.197425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2e80a-bb9c-4284-99f8-df5de01075bd service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:24.198893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7ea2e80a-bb9c-4284-99f8-df5de01075bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:24.220363 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2e80a-bb9c-4284-99f8-df5de01075bd service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:24.227745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:24.229136 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:24.229457 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:24.229739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] PATH_INFO: `/v3/projects/c159339920a0453eaf6cab55439d546a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:24.230989 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c159339920a0453eaf6cab55439d546a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:24.233712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:24.282156 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:24.297835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c159339920a0453eaf6cab55439d546a', 'request_id': 'req-9c47eac4-b3a5-41ad-9340-62ad53259781'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.305251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c159339920a0453eaf6cab55439d546a', 'request_id': 'req-9c47eac4-b3a5-41ad-9340-62ad53259781'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.314829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c159339920a0453eaf6cab55439d546a', 'request_id': 'req-9c47eac4-b3a5-41ad-9340-62ad53259781'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.327614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] The token cache is being invalidate because project c159339920a0453eaf6cab55439d546a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:24.328009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.328743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.330617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1278/2520] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:24 2022] DELETE /identity/v3/projects/c159339920a0453eaf6cab55439d546a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:24.334962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f51d7-488d-4339-981a-4a530b7fbb33 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:24.352110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f51d7-488d-4339-981a-4a530b7fbb33 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:24.425710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:24.426598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:24.427026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:24.427317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] PATH_INFO: `/v3/users/b8e7ba6bec634e5eaceedd3eda77be55` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:24.428645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e7ba6bec634e5eaceedd3eda77be55)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:24.430746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:24.503047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e7ba6bec634e5eaceedd3eda77be55'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.504288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e7ba6bec634e5eaceedd3eda77be55'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.524797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e7ba6bec634e5eaceedd3eda77be55'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.539344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e7ba6bec634e5eaceedd3eda77be55'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.540284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-e651ad89-c665-4b35-90cc-2981cc50c8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e7ba6bec634e5eaceedd3eda77be55'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:24.554054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1243/2521] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:24 2022] DELETE /identity/v3/users/b8e7ba6bec634e5eaceedd3eda77be55 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:24.873007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:24.874478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:24.887743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47eac4-b3a5-41ad-9340-62ad53259781 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:24.945176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:24.946039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:24.946321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:24.946597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] PATH_INFO: `/v3/projects/bfbfe3ff04c84e5990992cf5a23fd2c7` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:24.947807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfbfe3ff04c84e5990992cf5a23fd2c7)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:24.949730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:24.998587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbfe3ff04c84e5990992cf5a23fd2c7', 'request_id': 'req-90e8ed95-6d8d-4a06-8036-c36669e09b20'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:25.004772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbfe3ff04c84e5990992cf5a23fd2c7', 'request_id': 'req-90e8ed95-6d8d-4a06-8036-c36669e09b20'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:25.012527 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbfe3ff04c84e5990992cf5a23fd2c7', 'request_id': 'req-90e8ed95-6d8d-4a06-8036-c36669e09b20'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:25.025119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] The token cache is being invalidate because project bfbfe3ff04c84e5990992cf5a23fd2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:25.025406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:25.026094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-90e8ed95-6d8d-4a06-8036-c36669e09b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:25.027663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1279/2522] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:24 2022] DELETE /identity/v3/projects/bfbfe3ff04c84e5990992cf5a23fd2c7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:25.033074 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f42f9-da0c-4b4a-b409-fc27ef310856 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.033544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f42f9-da0c-4b4a-b409-fc27ef310856 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.033671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f42f9-da0c-4b4a-b409-fc27ef310856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.051812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-727f42f9-da0c-4b4a-b409-fc27ef310856 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:25.053025 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-727f42f9-da0c-4b4a-b409-fc27ef310856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:25.083466 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:25.116408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1244/2523] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:25.124314 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86916a-e859-4c61-943d-3846885318f7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.124607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86916a-e859-4c61-943d-3846885318f7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.124918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86916a-e859-4c61-943d-3846885318f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.143400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cb86916a-e859-4c61-943d-3846885318f7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:25.144659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cb86916a-e859-4c61-943d-3846885318f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:25.152824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1280/2524] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:25.157585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f42f9-da0c-4b4a-b409-fc27ef310856 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.167830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f42f9-da0c-4b4a-b409-fc27ef310856 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.172417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cd20a-df83-4aef-9aa2-c837012f0373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.173102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cd20a-df83-4aef-9aa2-c837012f0373 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.173384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cd20a-df83-4aef-9aa2-c837012f0373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.173661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cd20a-df83-4aef-9aa2-c837012f0373 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.174392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cd20a-df83-4aef-9aa2-c837012f0373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:25.174697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cd20a-df83-4aef-9aa2-c837012f0373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.176490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cd20a-df83-4aef-9aa2-c837012f0373 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.188222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1245/2525] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:33:25.192641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86916a-e859-4c61-943d-3846885318f7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.202892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86916a-e859-4c61-943d-3846885318f7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.207643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e665cf-11eb-4f33-b9ee-cd6142edf744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.208303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e665cf-11eb-4f33-b9ee-cd6142edf744 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.208590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e665cf-11eb-4f33-b9ee-cd6142edf744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.208868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e665cf-11eb-4f33-b9ee-cd6142edf744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.209576 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e665cf-11eb-4f33-b9ee-cd6142edf744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.211532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e665cf-11eb-4f33-b9ee-cd6142edf744 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.238499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1281/2526] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:25 2022] POST /identity/v3/projects => generated 378 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:25.242790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cd20a-df83-4aef-9aa2-c837012f0373 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.253064 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cd20a-df83-4aef-9aa2-c837012f0373 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.311275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c322c-f378-4e4e-81ff-5716252dd2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.311973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c322c-f378-4e4e-81ff-5716252dd2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.312255 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c322c-f378-4e4e-81ff-5716252dd2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.312530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c322c-f378-4e4e-81ff-5716252dd2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.313215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c322c-f378-4e4e-81ff-5716252dd2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.315139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c322c-f378-4e4e-81ff-5716252dd2e5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.335084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1246/2527] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:25 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:25.339078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e665cf-11eb-4f33-b9ee-cd6142edf744 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.349990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e665cf-11eb-4f33-b9ee-cd6142edf744 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.354857 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faeff7-5bda-4ccf-95e6-d5d7474884d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.355506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faeff7-5bda-4ccf-95e6-d5d7474884d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.355834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faeff7-5bda-4ccf-95e6-d5d7474884d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.356109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82faeff7-5bda-4ccf-95e6-d5d7474884d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.356834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82faeff7-5bda-4ccf-95e6-d5d7474884d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.358431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82faeff7-5bda-4ccf-95e6-d5d7474884d2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.368822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1282/2528] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:25.373360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c322c-f378-4e4e-81ff-5716252dd2e5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.383834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c322c-f378-4e4e-81ff-5716252dd2e5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.389279 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450486b9-932c-44b9-9fab-f7eea9ee1c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.389942 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450486b9-932c-44b9-9fab-f7eea9ee1c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.390230 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450486b9-932c-44b9-9fab-f7eea9ee1c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.390507 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450486b9-932c-44b9-9fab-f7eea9ee1c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.391237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450486b9-932c-44b9-9fab-f7eea9ee1c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.392956 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450486b9-932c-44b9-9fab-f7eea9ee1c92 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.403009 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1247/2529] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:25.407032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faeff7-5bda-4ccf-95e6-d5d7474884d2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.416934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82faeff7-5bda-4ccf-95e6-d5d7474884d2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.421555 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41dfa4-a44f-4205-974a-34610255c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.422423 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41dfa4-a44f-4205-974a-34610255c9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.422705 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41dfa4-a44f-4205-974a-34610255c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.422981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41dfa4-a44f-4205-974a-34610255c9ac admin admin] PATH_INFO: `/v3/projects/cd0e9377118f406287cf80440b4033a7/users/308762c5f05d42f1ac959486ef4083a7/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.435038 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:25.439043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41dfa4-a44f-4205-974a-34610255c9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0e9377118f406287cf80440b4033a7, user_id=308762c5f05d42f1ac959486ef4083a7, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.441856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41dfa4-a44f-4205-974a-34610255c9ac admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.457476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1283/2530] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:25 2022] PUT /identity/v3/projects/cd0e9377118f406287cf80440b4033a7/users/308762c5f05d42f1ac959486ef4083a7/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:25.467953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938cdea-2792-490f-9715-2ad9514dc530 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.468246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938cdea-2792-490f-9715-2ad9514dc530 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.468528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938cdea-2792-490f-9715-2ad9514dc530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.496005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f938cdea-2792-490f-9715-2ad9514dc530 None None] MFA Rules not processed for user `308762c5f05d42f1ac959486ef4083a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:25.497231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f938cdea-2792-490f-9715-2ad9514dc530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:25.560907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1248/2531] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:25.565387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41dfa4-a44f-4205-974a-34610255c9ac admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.625400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41dfa4-a44f-4205-974a-34610255c9ac admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.630182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ca02a-3f85-4e01-a765-f42ee0e4f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.630825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ca02a-3f85-4e01-a765-f42ee0e4f198 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.631103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ca02a-3f85-4e01-a765-f42ee0e4f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.631377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ca02a-3f85-4e01-a765-f42ee0e4f198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.632118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ca02a-3f85-4e01-a765-f42ee0e4f198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.634005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ca02a-3f85-4e01-a765-f42ee0e4f198 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.658828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1284/2532] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:25 2022] POST /identity/v3/projects => generated 378 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:25.662917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938cdea-2792-490f-9715-2ad9514dc530 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.673810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938cdea-2792-490f-9715-2ad9514dc530 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.700158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:25.733106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812183aa-d0e4-4702-a9e6-3d887def3596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.733791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812183aa-d0e4-4702-a9e6-3d887def3596 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.734072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812183aa-d0e4-4702-a9e6-3d887def3596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.734345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812183aa-d0e4-4702-a9e6-3d887def3596 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.735037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812183aa-d0e4-4702-a9e6-3d887def3596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.736993 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812183aa-d0e4-4702-a9e6-3d887def3596 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.757352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1249/2533] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:25 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:25.761435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ca02a-3f85-4e01-a765-f42ee0e4f198 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.771624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ca02a-3f85-4e01-a765-f42ee0e4f198 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.776201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113f00-2afd-43fc-b8db-0b08ea380c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.776845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113f00-2afd-43fc-b8db-0b08ea380c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.777124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113f00-2afd-43fc-b8db-0b08ea380c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.777399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91113f00-2afd-43fc-b8db-0b08ea380c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.778115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91113f00-2afd-43fc-b8db-0b08ea380c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.779731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91113f00-2afd-43fc-b8db-0b08ea380c79 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.790138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1285/2534] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:25 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:33:25.794148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812183aa-d0e4-4702-a9e6-3d887def3596 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.804697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812183aa-d0e4-4702-a9e6-3d887def3596 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.809331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65da88e-c713-4ac4-be2f-75274af4df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.809984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65da88e-c713-4ac4-be2f-75274af4df55 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.810266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65da88e-c713-4ac4-be2f-75274af4df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.811078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65da88e-c713-4ac4-be2f-75274af4df55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.811858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65da88e-c713-4ac4-be2f-75274af4df55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.813453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65da88e-c713-4ac4-be2f-75274af4df55 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.823221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1250/2535] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:25.827251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113f00-2afd-43fc-b8db-0b08ea380c79 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:25.836999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91113f00-2afd-43fc-b8db-0b08ea380c79 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:25.842249 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258f793-b844-4c01-9f6a-40e469ece05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:25.843137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258f793-b844-4c01-9f6a-40e469ece05c admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.843425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258f793-b844-4c01-9f6a-40e469ece05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.843749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258f793-b844-4c01-9f6a-40e469ece05c admin admin] PATH_INFO: `/v3/projects/3655e2c2affe4fdf9ff93735b093759f/users/6412c06f93b94073833a3abd47078be7/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.859370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258f793-b844-4c01-9f6a-40e469ece05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3655e2c2affe4fdf9ff93735b093759f, user_id=6412c06f93b94073833a3abd47078be7, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:25.862059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258f793-b844-4c01-9f6a-40e469ece05c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:25.879597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1286/2536] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:25 2022] PUT /identity/v3/projects/3655e2c2affe4fdf9ff93735b093759f/users/6412c06f93b94073833a3abd47078be7/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:25.891909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2966dd3-e4b9-4f8a-86d0-43d59bdc165c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:25.892288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2966dd3-e4b9-4f8a-86d0-43d59bdc165c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:25.892569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2966dd3-e4b9-4f8a-86d0-43d59bdc165c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:25.918605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-a2966dd3-e4b9-4f8a-86d0-43d59bdc165c None None] MFA Rules not processed for user `6412c06f93b94073833a3abd47078be7`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:25.920371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a2966dd3-e4b9-4f8a-86d0-43d59bdc165c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:25.984187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1251/2537] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:25.988613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258f793-b844-4c01-9f6a-40e469ece05c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:26.051796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258f793-b844-4c01-9f6a-40e469ece05c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:26.056484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7654b-e8e9-4aec-a946-4dacc72486e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:26.057137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7654b-e8e9-4aec-a946-4dacc72486e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:26.057416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7654b-e8e9-4aec-a946-4dacc72486e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:26.057687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7654b-e8e9-4aec-a946-4dacc72486e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:26.058385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7654b-e8e9-4aec-a946-4dacc72486e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:26.060891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7654b-e8e9-4aec-a946-4dacc72486e9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:26.085769 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1287/2538] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:25 2022] POST /identity/v3/projects => generated 378 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:26.090063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2966dd3-e4b9-4f8a-86d0-43d59bdc165c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:26.100938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2966dd3-e4b9-4f8a-86d0-43d59bdc165c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:26.156508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f3851-15ca-4002-8896-a6adf272f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:26.157092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f3851-15ca-4002-8896-a6adf272f855 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:26.157372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f3851-15ca-4002-8896-a6adf272f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:26.157644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f3851-15ca-4002-8896-a6adf272f855 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:26.158323 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f3851-15ca-4002-8896-a6adf272f855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:26.160304 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f3851-15ca-4002-8896-a6adf272f855 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:26.181085 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1252/2539] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:26 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:26.185079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7654b-e8e9-4aec-a946-4dacc72486e9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:26.195386 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7654b-e8e9-4aec-a946-4dacc72486e9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:26.200049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258d376-5efc-46f6-8c6d-2fecd699464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:26.200707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258d376-5efc-46f6-8c6d-2fecd699464d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:26.200996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258d376-5efc-46f6-8c6d-2fecd699464d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:26.201277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258d376-5efc-46f6-8c6d-2fecd699464d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:26.202005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258d376-5efc-46f6-8c6d-2fecd699464d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:26.203630 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258d376-5efc-46f6-8c6d-2fecd699464d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:26.214335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1288/2540] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:26 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:26.219470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f3851-15ca-4002-8896-a6adf272f855 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:26.230702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f3851-15ca-4002-8896-a6adf272f855 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:26.236060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b571a6-3408-4b2d-9791-313185a0c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:26.236939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b571a6-3408-4b2d-9791-313185a0c4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:26.237225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b571a6-3408-4b2d-9791-313185a0c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:26.237505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b571a6-3408-4b2d-9791-313185a0c4e4 admin admin] PATH_INFO: `/v3/projects/48cee0bdc07743b6b68a3c4f861151fd/users/0cd54a64e18949128c6bf33b33f066d5/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:26.252133 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b571a6-3408-4b2d-9791-313185a0c4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cee0bdc07743b6b68a3c4f861151fd, user_id=0cd54a64e18949128c6bf33b33f066d5, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:26.254805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b571a6-3408-4b2d-9791-313185a0c4e4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:26.269506 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1253/2541] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:26 2022] PUT /identity/v3/projects/48cee0bdc07743b6b68a3c4f861151fd/users/0cd54a64e18949128c6bf33b33f066d5/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:26.274151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258d376-5efc-46f6-8c6d-2fecd699464d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:26.285081 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258d376-5efc-46f6-8c6d-2fecd699464d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:26.297018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:26.342295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229c7e8-994e-40a1-9768-f2db263cfe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:26.342958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229c7e8-994e-40a1-9768-f2db263cfe7d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:26.343247 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229c7e8-994e-40a1-9768-f2db263cfe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:26.343528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229c7e8-994e-40a1-9768-f2db263cfe7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:26.344293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229c7e8-994e-40a1-9768-f2db263cfe7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:26.345909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229c7e8-994e-40a1-9768-f2db263cfe7d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:26.356218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1289/2542] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:26 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:26.360930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b571a6-3408-4b2d-9791-313185a0c4e4 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:26.366430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:26.372777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b571a6-3408-4b2d-9791-313185a0c4e4 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:26.377842 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4548c46-26f3-4728-9a64-57052789b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:26.378720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4548c46-26f3-4728-9a64-57052789b1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:26.379007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4548c46-26f3-4728-9a64-57052789b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:26.379289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4548c46-26f3-4728-9a64-57052789b1f3 admin admin] PATH_INFO: `/v3/projects/48cee0bdc07743b6b68a3c4f861151fd/users/0cd54a64e18949128c6bf33b33f066d5/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:26.381328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4548c46-26f3-4728-9a64-57052789b1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cee0bdc07743b6b68a3c4f861151fd, user_id=0cd54a64e18949128c6bf33b33f066d5, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:26.384022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4548c46-26f3-4728-9a64-57052789b1f3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:26.394265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1254/2543] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:26 2022] PUT /identity/v3/projects/48cee0bdc07743b6b68a3c4f861151fd/users/0cd54a64e18949128c6bf33b33f066d5/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:26.404896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9627559-337e-4d96-9339-1b1a01a841d8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:26.405215 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9627559-337e-4d96-9339-1b1a01a841d8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:26.405504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9627559-337e-4d96-9339-1b1a01a841d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:26.432487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a9627559-337e-4d96-9339-1b1a01a841d8 None None] MFA Rules not processed for user `0cd54a64e18949128c6bf33b33f066d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:26.433628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a9627559-337e-4d96-9339-1b1a01a841d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:26.505280 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1290/2544] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:26.517807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4548c46-26f3-4728-9a64-57052789b1f3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:26.519645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e4548c46-26f3-4728-9a64-57052789b1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:26.577641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4548c46-26f3-4728-9a64-57052789b1f3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:26.581591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dffc3-e038-479b-bca4-73dcbff76487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:26.582260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dffc3-e038-479b-bca4-73dcbff76487 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:26.582528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dffc3-e038-479b-bca4-73dcbff76487 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:26.582805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dffc3-e038-479b-bca4-73dcbff76487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:26.591968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dffc3-e038-479b-bca4-73dcbff76487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:26.593400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dffc3-e038-479b-bca4-73dcbff76487 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:26.603523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1255/2545] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:26.643345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9627559-337e-4d96-9339-1b1a01a841d8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:26.644803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a9627559-337e-4d96-9339-1b1a01a841d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:26.657827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9627559-337e-4d96-9339-1b1a01a841d8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:26.661588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39d74-1b53-451a-bbdb-399a0d9c2774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:26.662231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39d74-1b53-451a-bbdb-399a0d9c2774 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:26.662503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39d74-1b53-451a-bbdb-399a0d9c2774 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:26.662773 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39d74-1b53-451a-bbdb-399a0d9c2774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:26.720699 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39d74-1b53-451a-bbdb-399a0d9c2774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:26.722146 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39d74-1b53-451a-bbdb-399a0d9c2774 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:26.731449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1291/2546] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:27.450729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dffc3-e038-479b-bca4-73dcbff76487 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:27.460944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dffc3-e038-479b-bca4-73dcbff76487 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:27.465577 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0577a5c-b734-4118-aea8-a4fc68ba9635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:27.466366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577a5c-b734-4118-aea8-a4fc68ba9635 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:27.466778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577a5c-b734-4118-aea8-a4fc68ba9635 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:27.467124 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577a5c-b734-4118-aea8-a4fc68ba9635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:27.469276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c0577a5c-b734-4118-aea8-a4fc68ba9635 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:27.535612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0577a5c-b734-4118-aea8-a4fc68ba9635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:27.536970 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0577a5c-b734-4118-aea8-a4fc68ba9635 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:27.546857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1256/2547] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:29.611646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39d74-1b53-451a-bbdb-399a0d9c2774 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:29.655110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:29.678942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39d74-1b53-451a-bbdb-399a0d9c2774 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:29.684393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:29.685252 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:29.685666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:29.686068 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] PATH_INFO: `/v3/users/308762c5f05d42f1ac959486ef4083a7` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:29.687399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=308762c5f05d42f1ac959486ef4083a7)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:29.689361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:29.738959 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308762c5f05d42f1ac959486ef4083a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:29.739657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308762c5f05d42f1ac959486ef4083a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:29.746927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308762c5f05d42f1ac959486ef4083a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:29.747806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308762c5f05d42f1ac959486ef4083a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:29.756138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308762c5f05d42f1ac959486ef4083a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:29.782332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1292/2548] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:29 2022] DELETE /identity/v3/users/308762c5f05d42f1ac959486ef4083a7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:33:29.786952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8991f-6d28-4401-af48-87fa5b8528ca None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:29.787505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8991f-6d28-4401-af48-87fa5b8528ca None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:29.787782 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8991f-6d28-4401-af48-87fa5b8528ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:29.812515 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-27a8991f-6d28-4401-af48-87fa5b8528ca None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:29.813834 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-27a8991f-6d28-4401-af48-87fa5b8528ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:29.876142 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1257/2549] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:29.886816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:29.888337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:29.947046 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284932f-a1ba-44dc-afbe-1b95481200fb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:29.950702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805056d-cc50-46c7-9a57-26e4f974df49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:29.951931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805056d-cc50-46c7-9a57-26e4f974df49 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:29.952218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805056d-cc50-46c7-9a57-26e4f974df49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:29.952497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805056d-cc50-46c7-9a57-26e4f974df49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:29.961964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805056d-cc50-46c7-9a57-26e4f974df49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:29.963407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805056d-cc50-46c7-9a57-26e4f974df49 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:29.973442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1293/2550] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:33:30.646469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8991f-6d28-4401-af48-87fa5b8528ca None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:30.647927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-27a8991f-6d28-4401-af48-87fa5b8528ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:30.666838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8991f-6d28-4401-af48-87fa5b8528ca None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:30.672110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:30.672982 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:30.673262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:30.673615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] PATH_INFO: `/v3/projects/cd0e9377118f406287cf80440b4033a7` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:30.674850 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0e9377118f406287cf80440b4033a7)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:30.676944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:30.721098 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:30.742273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0e9377118f406287cf80440b4033a7', 'request_id': 'req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.748708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0e9377118f406287cf80440b4033a7', 'request_id': 'req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.756602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0e9377118f406287cf80440b4033a7', 'request_id': 'req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.768126 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] The token cache is being invalidate because project cd0e9377118f406287cf80440b4033a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:30.769459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.769986 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.771610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1258/2551] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:30 2022] DELETE /identity/v3/projects/cd0e9377118f406287cf80440b4033a7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:30.775759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805056d-cc50-46c7-9a57-26e4f974df49 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:30.786509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805056d-cc50-46c7-9a57-26e4f974df49 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:30.841792 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:30.849456 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:30.850710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:30.852078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:30.852461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] PATH_INFO: `/v3/users/6412c06f93b94073833a3abd47078be7` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:30.853696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6412c06f93b94073833a3abd47078be7)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:30.855647 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:30.905072 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6412c06f93b94073833a3abd47078be7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.905676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6412c06f93b94073833a3abd47078be7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.913818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6412c06f93b94073833a3abd47078be7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.914621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6412c06f93b94073833a3abd47078be7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.922585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6412c06f93b94073833a3abd47078be7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:30.940978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1294/2552] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:30 2022] DELETE /identity/v3/users/6412c06f93b94073833a3abd47078be7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:31.237260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:31.238778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:31.257803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bb37b-8be1-4012-90e9-ffa7547bf03f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:31.318622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:31.319492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:31.319802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:31.320076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] PATH_INFO: `/v3/projects/3655e2c2affe4fdf9ff93735b093759f` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:31.321282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3655e2c2affe4fdf9ff93735b093759f)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:31.323226 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:31.375027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3655e2c2affe4fdf9ff93735b093759f', 'request_id': 'req-1195451a-bb63-4b8b-bfc6-768aa9839f4b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.385607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3655e2c2affe4fdf9ff93735b093759f', 'request_id': 'req-1195451a-bb63-4b8b-bfc6-768aa9839f4b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.399934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3655e2c2affe4fdf9ff93735b093759f', 'request_id': 'req-1195451a-bb63-4b8b-bfc6-768aa9839f4b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.414247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] The token cache is being invalidate because project 3655e2c2affe4fdf9ff93735b093759f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:31.414538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.415187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.416753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1259/2553] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:31 2022] DELETE /identity/v3/projects/3655e2c2affe4fdf9ff93735b093759f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:33:31.422051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:31.423777 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:31.438426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b54e2-659e-4301-a6fd-19fa68bd1d50 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:31.498492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:31.499370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:31.499688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:31.499973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] PATH_INFO: `/v3/users/0cd54a64e18949128c6bf33b33f066d5` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:31.501179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd54a64e18949128c6bf33b33f066d5)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:31.503105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:31.554778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd54a64e18949128c6bf33b33f066d5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.555546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd54a64e18949128c6bf33b33f066d5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.562947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd54a64e18949128c6bf33b33f066d5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.563665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd54a64e18949128c6bf33b33f066d5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.571955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6c6b1695-8295-4fed-9a18-1b7fcbc72342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd54a64e18949128c6bf33b33f066d5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:31.584994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:31.594661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1295/2554] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:31 2022] DELETE /identity/v3/users/0cd54a64e18949128c6bf33b33f066d5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:31.879807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:31.881253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:31.897058 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195451a-bb63-4b8b-bfc6-768aa9839f4b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:31.944776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:31.962657 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:31.963589 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:31.963874 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:31.964152 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] PATH_INFO: `/v3/projects/48cee0bdc07743b6b68a3c4f861151fd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:31.965351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cee0bdc07743b6b68a3c4f861151fd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:31.968093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.023196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cee0bdc07743b6b68a3c4f861151fd', 'request_id': 'req-601058be-22ee-43ce-ba37-360c7fb8a3d1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:32.030524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cee0bdc07743b6b68a3c4f861151fd', 'request_id': 'req-601058be-22ee-43ce-ba37-360c7fb8a3d1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:32.038355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cee0bdc07743b6b68a3c4f861151fd', 'request_id': 'req-601058be-22ee-43ce-ba37-360c7fb8a3d1'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:32.049435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] The token cache is being invalidate because project 48cee0bdc07743b6b68a3c4f861151fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:32.050194 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:32.050383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-601058be-22ee-43ce-ba37-360c7fb8a3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:32.052019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1260/2555] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:31 2022] DELETE /identity/v3/projects/48cee0bdc07743b6b68a3c4f861151fd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:32.057975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa4f77-11a3-4e79-8484-32d81c70feac None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.058535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa4f77-11a3-4e79-8484-32d81c70feac None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.058535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa4f77-11a3-4e79-8484-32d81c70feac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.079690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0faa4f77-11a3-4e79-8484-32d81c70feac None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:32.080899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0faa4f77-11a3-4e79-8484-32d81c70feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:32.146283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1296/2556] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:32.154870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd17c1-035c-4bbf-b3d0-44ddb1d2771e None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.155181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd17c1-035c-4bbf-b3d0-44ddb1d2771e None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.155467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd17c1-035c-4bbf-b3d0-44ddb1d2771e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.174498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-6edd17c1-035c-4bbf-b3d0-44ddb1d2771e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:32.175760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6edd17c1-035c-4bbf-b3d0-44ddb1d2771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:32.185624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1261/2557] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:32.190450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa4f77-11a3-4e79-8484-32d81c70feac None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.201835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa4f77-11a3-4e79-8484-32d81c70feac None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.206627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7f52-e27c-4a7c-94f2-b8c9ac16249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.207294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7f52-e27c-4a7c-94f2-b8c9ac16249b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.207665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7f52-e27c-4a7c-94f2-b8c9ac16249b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.207934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7f52-e27c-4a7c-94f2-b8c9ac16249b admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.208742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7f52-e27c-4a7c-94f2-b8c9ac16249b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:32.209050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7f52-e27c-4a7c-94f2-b8c9ac16249b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.210692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7f52-e27c-4a7c-94f2-b8c9ac16249b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.225296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1297/2558] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:33:32.230968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd17c1-035c-4bbf-b3d0-44ddb1d2771e None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.240601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd17c1-035c-4bbf-b3d0-44ddb1d2771e None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.245477 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d60f7e-7789-4d96-a375-81f551ad66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.246165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d60f7e-7789-4d96-a375-81f551ad66f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.246449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d60f7e-7789-4d96-a375-81f551ad66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.246783 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d60f7e-7789-4d96-a375-81f551ad66f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.248073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d60f7e-7789-4d96-a375-81f551ad66f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.250106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d60f7e-7789-4d96-a375-81f551ad66f7 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.278440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1262/2559] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:32 2022] POST /identity/v3/projects => generated 380 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:32.282614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7f52-e27c-4a7c-94f2-b8c9ac16249b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.292810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7f52-e27c-4a7c-94f2-b8c9ac16249b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.351919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047d788-32f5-470c-ab69-a1775aed3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.352596 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047d788-32f5-470c-ab69-a1775aed3233 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.352884 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047d788-32f5-470c-ab69-a1775aed3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.353167 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047d788-32f5-470c-ab69-a1775aed3233 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.353874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047d788-32f5-470c-ab69-a1775aed3233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.355916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047d788-32f5-470c-ab69-a1775aed3233 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.379005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1298/2560] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:32 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:33:32.383162 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d60f7e-7789-4d96-a375-81f551ad66f7 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.394021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d60f7e-7789-4d96-a375-81f551ad66f7 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.398582 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0fec6-1767-4188-9599-2a75c2fc2120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.399235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0fec6-1767-4188-9599-2a75c2fc2120 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.399519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0fec6-1767-4188-9599-2a75c2fc2120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.399825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0fec6-1767-4188-9599-2a75c2fc2120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.400572 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0fec6-1767-4188-9599-2a75c2fc2120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.402174 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0fec6-1767-4188-9599-2a75c2fc2120 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.412586 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1263/2561] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:32 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:32.416685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047d788-32f5-470c-ab69-a1775aed3233 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.426765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047d788-32f5-470c-ab69-a1775aed3233 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.431636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b888f5-b5e5-4cdc-be02-8e486145db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.432301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b888f5-b5e5-4cdc-be02-8e486145db4f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.432584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b888f5-b5e5-4cdc-be02-8e486145db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.432864 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b888f5-b5e5-4cdc-be02-8e486145db4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.433589 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b888f5-b5e5-4cdc-be02-8e486145db4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.435787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b888f5-b5e5-4cdc-be02-8e486145db4f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.446911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1299/2562] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:32 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:32.451117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0fec6-1767-4188-9599-2a75c2fc2120 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.462440 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0fec6-1767-4188-9599-2a75c2fc2120 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.467690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2fa1b-3dba-4483-a762-aeb8db4f6b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.468575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2fa1b-3dba-4483-a762-aeb8db4f6b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.468860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2fa1b-3dba-4483-a762-aeb8db4f6b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.469141 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2fa1b-3dba-4483-a762-aeb8db4f6b95 admin admin] PATH_INFO: `/v3/projects/4445604eee234a8ca002dd2aafc29f20/users/1152096e500e4788a2b1f09e1a7aa383/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.484981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2fa1b-3dba-4483-a762-aeb8db4f6b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4445604eee234a8ca002dd2aafc29f20, user_id=1152096e500e4788a2b1f09e1a7aa383, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.487714 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2fa1b-3dba-4483-a762-aeb8db4f6b95 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.500671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1264/2563] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:32 2022] PUT /identity/v3/projects/4445604eee234a8ca002dd2aafc29f20/users/1152096e500e4788a2b1f09e1a7aa383/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:32.512945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f3580-1e69-43ae-89d0-f78dc427420a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.513786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f3580-1e69-43ae-89d0-f78dc427420a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.514060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f3580-1e69-43ae-89d0-f78dc427420a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.542237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e73f3580-1e69-43ae-89d0-f78dc427420a None None] MFA Rules not processed for user `1152096e500e4788a2b1f09e1a7aa383`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:32.543469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e73f3580-1e69-43ae-89d0-f78dc427420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:32.594831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:32.615804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1300/2564] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:32.620417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2fa1b-3dba-4483-a762-aeb8db4f6b95 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.683823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2fa1b-3dba-4483-a762-aeb8db4f6b95 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.688648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4835d8e-c2db-4e05-b20e-423c55f46b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.689312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4835d8e-c2db-4e05-b20e-423c55f46b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.689592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4835d8e-c2db-4e05-b20e-423c55f46b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.689870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4835d8e-c2db-4e05-b20e-423c55f46b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.690573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4835d8e-c2db-4e05-b20e-423c55f46b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.692600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4835d8e-c2db-4e05-b20e-423c55f46b8a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.707047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:32.722272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1265/2565] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:32 2022] POST /identity/v3/projects => generated 380 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:32.726584 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f3580-1e69-43ae-89d0-f78dc427420a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.738138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f3580-1e69-43ae-89d0-f78dc427420a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.795340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c11708-d06a-4eae-bc4a-b8d9733df0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.796051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c11708-d06a-4eae-bc4a-b8d9733df0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.796336 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c11708-d06a-4eae-bc4a-b8d9733df0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.796611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c11708-d06a-4eae-bc4a-b8d9733df0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.797311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c11708-d06a-4eae-bc4a-b8d9733df0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.799209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c11708-d06a-4eae-bc4a-b8d9733df0e7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.818580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1301/2566] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:32 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:32.822742 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4835d8e-c2db-4e05-b20e-423c55f46b8a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.833808 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4835d8e-c2db-4e05-b20e-423c55f46b8a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.838692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873d30-3ad7-4587-89dd-cf32fa766526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.839366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873d30-3ad7-4587-89dd-cf32fa766526 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.839694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873d30-3ad7-4587-89dd-cf32fa766526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.839981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79873d30-3ad7-4587-89dd-cf32fa766526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.840742 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873d30-3ad7-4587-89dd-cf32fa766526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.842972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79873d30-3ad7-4587-89dd-cf32fa766526 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.854694 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1266/2567] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:32 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:32.859158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c11708-d06a-4eae-bc4a-b8d9733df0e7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.869424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c11708-d06a-4eae-bc4a-b8d9733df0e7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.874643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0ef0-7463-4a2f-8109-fd56429c5df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.875521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0ef0-7463-4a2f-8109-fd56429c5df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.875841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0ef0-7463-4a2f-8109-fd56429c5df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.876154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0ef0-7463-4a2f-8109-fd56429c5df3 admin admin] PATH_INFO: `/v3/projects/dc85651bcc9a4720b01672f7393c48fd/users/7756c81cc5e544c0bd0d2273b50b7aeb/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.892861 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c0ef0-7463-4a2f-8109-fd56429c5df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc85651bcc9a4720b01672f7393c48fd, user_id=7756c81cc5e544c0bd0d2273b50b7aeb, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.895512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c0ef0-7463-4a2f-8109-fd56429c5df3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.908501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1302/2568] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:32 2022] PUT /identity/v3/projects/dc85651bcc9a4720b01672f7393c48fd/users/7756c81cc5e544c0bd0d2273b50b7aeb/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:32.912417 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873d30-3ad7-4587-89dd-cf32fa766526 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:32.922508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79873d30-3ad7-4587-89dd-cf32fa766526 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:32.984439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64f3db-482f-4c42-b9a4-91f910315bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:32.985044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64f3db-482f-4c42-b9a4-91f910315bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:32.985326 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64f3db-482f-4c42-b9a4-91f910315bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:32.985603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64f3db-482f-4c42-b9a4-91f910315bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:32.986385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64f3db-482f-4c42-b9a4-91f910315bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:32.988066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64f3db-482f-4c42-b9a4-91f910315bbd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:32.998719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1267/2569] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:32 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:33.002988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0ef0-7463-4a2f-8109-fd56429c5df3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:33.013493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0ef0-7463-4a2f-8109-fd56429c5df3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:33.018344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702392-8e7d-45a9-aa54-2c704c884fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:33.019216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702392-8e7d-45a9-aa54-2c704c884fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:33.019499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702392-8e7d-45a9-aa54-2c704c884fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:33.019806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702392-8e7d-45a9-aa54-2c704c884fe8 admin admin] PATH_INFO: `/v3/projects/dc85651bcc9a4720b01672f7393c48fd/users/7756c81cc5e544c0bd0d2273b50b7aeb/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:33.021789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa702392-8e7d-45a9-aa54-2c704c884fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc85651bcc9a4720b01672f7393c48fd, user_id=7756c81cc5e544c0bd0d2273b50b7aeb, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:33.024733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa702392-8e7d-45a9-aa54-2c704c884fe8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:33.036751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1303/2570] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:33 2022] PUT /identity/v3/projects/dc85651bcc9a4720b01672f7393c48fd/users/7756c81cc5e544c0bd0d2273b50b7aeb/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:33.048623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6a435-a933-4f40-b42d-ab51a722a441 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:33.048959 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6a435-a933-4f40-b42d-ab51a722a441 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:33.049241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6a435-a933-4f40-b42d-ab51a722a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:33.077380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-bbe6a435-a933-4f40-b42d-ab51a722a441 None None] MFA Rules not processed for user `7756c81cc5e544c0bd0d2273b50b7aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:33.078612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-bbe6a435-a933-4f40-b42d-ab51a722a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:33.151971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1268/2571] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:33:33.163681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702392-8e7d-45a9-aa54-2c704c884fe8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:33.165418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa702392-8e7d-45a9-aa54-2c704c884fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:33.236713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702392-8e7d-45a9-aa54-2c704c884fe8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:33.243154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824765f-0007-40f0-bbdf-20bb650f3380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:33.243839 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824765f-0007-40f0-bbdf-20bb650f3380 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:33.244140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824765f-0007-40f0-bbdf-20bb650f3380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:33.244413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824765f-0007-40f0-bbdf-20bb650f3380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:33.255199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824765f-0007-40f0-bbdf-20bb650f3380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:33.257315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824765f-0007-40f0-bbdf-20bb650f3380 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:33.272097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1304/2572] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:33.698651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6a435-a933-4f40-b42d-ab51a722a441 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:33.762014 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6a435-a933-4f40-b42d-ab51a722a441 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:33.767093 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:33.768060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:33.768347 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:33.768625 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] PATH_INFO: `/v3/users/1152096e500e4788a2b1f09e1a7aa383` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:33.769876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1152096e500e4788a2b1f09e1a7aa383)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:33.771989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:33.777643 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:33.818893 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1152096e500e4788a2b1f09e1a7aa383'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:33.819593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1152096e500e4788a2b1f09e1a7aa383'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:33.831395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1152096e500e4788a2b1f09e1a7aa383'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:33.838173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1152096e500e4788a2b1f09e1a7aa383'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:33.838839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1152096e500e4788a2b1f09e1a7aa383'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:33.852679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1269/2573] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:33 2022] DELETE /identity/v3/users/1152096e500e4788a2b1f09e1a7aa383 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:33.857772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c50f-fe17-4e92-9bde-cb3349e28e11 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:33.858062 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c50f-fe17-4e92-9bde-cb3349e28e11 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:33.858343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c50f-fe17-4e92-9bde-cb3349e28e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:33.875813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f404c50f-fe17-4e92-9bde-cb3349e28e11 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:33.877024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f404c50f-fe17-4e92-9bde-cb3349e28e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:33.923739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:33.941733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1305/2574] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:33:33.951251 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:33.952697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:34.009548 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3cbab-52a6-4a0f-979a-7d79631d388c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:34.014144 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfcf94-0f00-4b4e-9b0f-c60905904e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:34.014736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfcf94-0f00-4b4e-9b0f-c60905904e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:34.015023 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfcf94-0f00-4b4e-9b0f-c60905904e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:34.015352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfcf94-0f00-4b4e-9b0f-c60905904e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:34.026637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfcf94-0f00-4b4e-9b0f-c60905904e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:34.029471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfcf94-0f00-4b4e-9b0f-c60905904e2a service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:34.041630 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1270/2575] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:34.307945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404c50f-fe17-4e92-9bde-cb3349e28e11 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:34.309548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f404c50f-fe17-4e92-9bde-cb3349e28e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:34.324692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404c50f-fe17-4e92-9bde-cb3349e28e11 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:34.329918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:34.330780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:34.331063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:34.331381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] PATH_INFO: `/v3/projects/4445604eee234a8ca002dd2aafc29f20` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:34.332678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4445604eee234a8ca002dd2aafc29f20)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:34.334525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:34.383958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4445604eee234a8ca002dd2aafc29f20', 'request_id': 'req-9d39d16f-e46d-4fca-93ee-bdb9620840b9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.390874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4445604eee234a8ca002dd2aafc29f20', 'request_id': 'req-9d39d16f-e46d-4fca-93ee-bdb9620840b9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.399623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4445604eee234a8ca002dd2aafc29f20', 'request_id': 'req-9d39d16f-e46d-4fca-93ee-bdb9620840b9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.410051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] The token cache is being invalidate because project 4445604eee234a8ca002dd2aafc29f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:34.410336 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.411069 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.412678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1306/2576] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:34 2022] DELETE /identity/v3/projects/4445604eee234a8ca002dd2aafc29f20 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:34.416659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfcf94-0f00-4b4e-9b0f-c60905904e2a service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:34.427365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfcf94-0f00-4b4e-9b0f-c60905904e2a service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:34.490791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:34.491724 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:34.492013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:34.492292 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] PATH_INFO: `/v3/users/7756c81cc5e544c0bd0d2273b50b7aeb` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:34.493754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7756c81cc5e544c0bd0d2273b50b7aeb)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:34.495849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:34.525991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:34.527451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:34.537795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:34.553463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7756c81cc5e544c0bd0d2273b50b7aeb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.554046 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7756c81cc5e544c0bd0d2273b50b7aeb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.567710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7756c81cc5e544c0bd0d2273b50b7aeb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.575313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7756c81cc5e544c0bd0d2273b50b7aeb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.576750 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7756c81cc5e544c0bd0d2273b50b7aeb'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.590219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1271/2577] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:34 2022] DELETE /identity/v3/users/7756c81cc5e544c0bd0d2273b50b7aeb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:34.590934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39d16f-e46d-4fca-93ee-bdb9620840b9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:34.642181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddcb08-cb29-4266-8a8d-b15f14849a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:34.642922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddcb08-cb29-4266-8a8d-b15f14849a4c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:34.643316 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddcb08-cb29-4266-8a8d-b15f14849a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:34.643620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddcb08-cb29-4266-8a8d-b15f14849a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:34.645801 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-74ddcb08-cb29-4266-8a8d-b15f14849a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:34.690626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:34.716351 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddcb08-cb29-4266-8a8d-b15f14849a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:34.717831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddcb08-cb29-4266-8a8d-b15f14849a4c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:34.729292 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1307/2578] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:33:34.873617 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:34.875219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:34.894719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20fd98-22f0-44cf-bc47-d6d1eb17c03a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:34.908103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:34.909017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:34.909301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:34.909581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] PATH_INFO: `/v3/projects/dc85651bcc9a4720b01672f7393c48fd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:34.910795 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc85651bcc9a4720b01672f7393c48fd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:34.912764 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:34.962522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc85651bcc9a4720b01672f7393c48fd', 'request_id': 'req-d67be4cf-2eeb-4aa7-acea-9474818fbe11'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.968772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc85651bcc9a4720b01672f7393c48fd', 'request_id': 'req-d67be4cf-2eeb-4aa7-acea-9474818fbe11'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.978258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc85651bcc9a4720b01672f7393c48fd', 'request_id': 'req-d67be4cf-2eeb-4aa7-acea-9474818fbe11'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.990017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] The token cache is being invalidate because project dc85651bcc9a4720b01672f7393c48fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:34.990311 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.991022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d67be4cf-2eeb-4aa7-acea-9474818fbe11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:34.992598 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1272/2579] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:34 2022] DELETE /identity/v3/projects/dc85651bcc9a4720b01672f7393c48fd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:34.998277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5fa3a-2807-47be-b599-53a0be2c8461 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:34.998574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5fa3a-2807-47be-b599-53a0be2c8461 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:34.998854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5fa3a-2807-47be-b599-53a0be2c8461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.016582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a0b5fa3a-2807-47be-b599-53a0be2c8461 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:35.017807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a0b5fa3a-2807-47be-b599-53a0be2c8461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:35.085565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1308/2580] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:35.094637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633678-7092-442c-8305-c3641154109f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:35.095060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633678-7092-442c-8305-c3641154109f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:35.095439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633678-7092-442c-8305-c3641154109f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.115256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b4633678-7092-442c-8305-c3641154109f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:35.116523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b4633678-7092-442c-8305-c3641154109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:35.126060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1273/2581] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:35.130464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5fa3a-2807-47be-b599-53a0be2c8461 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:35.140507 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5fa3a-2807-47be-b599-53a0be2c8461 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:35.145865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ca61-c6fa-4975-b860-34d737bda815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:35.146534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ca61-c6fa-4975-b860-34d737bda815 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:35.146893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ca61-c6fa-4975-b860-34d737bda815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:35.147533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ca61-c6fa-4975-b860-34d737bda815 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.148552 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ca61-c6fa-4975-b860-34d737bda815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:35.148869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ca61-c6fa-4975-b860-34d737bda815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:35.150744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ca61-c6fa-4975-b860-34d737bda815 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:35.168225 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1309/2582] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:33:35.172997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633678-7092-442c-8305-c3641154109f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:35.182507 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633678-7092-442c-8305-c3641154109f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:35.187791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475ebc4-a0a4-4901-808d-ac5c447edb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:35.188459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475ebc4-a0a4-4901-808d-ac5c447edb51 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:35.188743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475ebc4-a0a4-4901-808d-ac5c447edb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:35.189020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475ebc4-a0a4-4901-808d-ac5c447edb51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.189712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475ebc4-a0a4-4901-808d-ac5c447edb51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:35.192031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475ebc4-a0a4-4901-808d-ac5c447edb51 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:35.223083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1274/2583] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:35 2022] POST /identity/v3/projects => generated 374 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:35.224915 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ca61-c6fa-4975-b860-34d737bda815 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:35.235532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ca61-c6fa-4975-b860-34d737bda815 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:35.293708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d23a28-2cd1-44a1-a2b2-f3c5fc354d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:35.295016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d23a28-2cd1-44a1-a2b2-f3c5fc354d9d admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:35.295372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d23a28-2cd1-44a1-a2b2-f3c5fc354d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:35.295688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d23a28-2cd1-44a1-a2b2-f3c5fc354d9d admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.296404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d23a28-2cd1-44a1-a2b2-f3c5fc354d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:35.298487 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d23a28-2cd1-44a1-a2b2-f3c5fc354d9d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:35.318683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1310/2584] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:35 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:35.322840 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475ebc4-a0a4-4901-808d-ac5c447edb51 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:35.333084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475ebc4-a0a4-4901-808d-ac5c447edb51 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:35.337906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae5d34-83b0-4f20-af47-b7208d8a9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:35.338513 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae5d34-83b0-4f20-af47-b7208d8a9ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:35.338788 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae5d34-83b0-4f20-af47-b7208d8a9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:35.339067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae5d34-83b0-4f20-af47-b7208d8a9ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.339846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae5d34-83b0-4f20-af47-b7208d8a9ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:35.341985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae5d34-83b0-4f20-af47-b7208d8a9ccb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:35.367591 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1275/2585] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:35 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:35.416725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d23a28-2cd1-44a1-a2b2-f3c5fc354d9d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:35.426935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d23a28-2cd1-44a1-a2b2-f3c5fc354d9d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:35.431751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02f7a8-33c1-4609-b6ea-a62c0ef1ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:35.432414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02f7a8-33c1-4609-b6ea-a62c0ef1ba0b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:35.432726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02f7a8-33c1-4609-b6ea-a62c0ef1ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:35.433002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02f7a8-33c1-4609-b6ea-a62c0ef1ba0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.433730 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02f7a8-33c1-4609-b6ea-a62c0ef1ba0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:35.435878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02f7a8-33c1-4609-b6ea-a62c0ef1ba0b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:35.446319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1311/2586] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:35 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:35.450558 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae5d34-83b0-4f20-af47-b7208d8a9ccb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:35.461384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae5d34-83b0-4f20-af47-b7208d8a9ccb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:35.466030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee67084-7122-4de4-838f-bfd020ca1d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:35.467002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee67084-7122-4de4-838f-bfd020ca1d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:35.467284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee67084-7122-4de4-838f-bfd020ca1d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:35.467585 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee67084-7122-4de4-838f-bfd020ca1d74 admin admin] PATH_INFO: `/v3/projects/5abb91c423c94f359f8e20b42d1be855/users/1b8c22f499404708ab41391eb363ccfb/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.483203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee67084-7122-4de4-838f-bfd020ca1d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abb91c423c94f359f8e20b42d1be855, user_id=1b8c22f499404708ab41391eb363ccfb, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:35.485874 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee67084-7122-4de4-838f-bfd020ca1d74 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:35.499792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1276/2587] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:35 2022] PUT /identity/v3/projects/5abb91c423c94f359f8e20b42d1be855/users/1b8c22f499404708ab41391eb363ccfb/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:35.504922 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3d76-a88a-4930-a3d1-1792783677f5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:35.505279 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3d76-a88a-4930-a3d1-1792783677f5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:35.505621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3d76-a88a-4930-a3d1-1792783677f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.525956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-77fd3d76-a88a-4930-a3d1-1792783677f5 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:35.527275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-77fd3d76-a88a-4930-a3d1-1792783677f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:35.566996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:35.595537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1312/2588] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:33:35.605520 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee67084-7122-4de4-838f-bfd020ca1d74 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:35.607953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1ee67084-7122-4de4-838f-bfd020ca1d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:35.646711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:35.680498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee67084-7122-4de4-838f-bfd020ca1d74 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:35.686767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946aaaa6-53e1-4701-935a-ed170eb02950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:35.687534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946aaaa6-53e1-4701-935a-ed170eb02950 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:35.688121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946aaaa6-53e1-4701-935a-ed170eb02950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:35.688411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946aaaa6-53e1-4701-935a-ed170eb02950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:35.698525 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946aaaa6-53e1-4701-935a-ed170eb02950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:35.700105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946aaaa6-53e1-4701-935a-ed170eb02950 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:35.711111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1277/2589] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:36.390419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003207f-dee0-4fcf-9e74-6065dfd2102d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:36.391135 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003207f-dee0-4fcf-9e74-6065dfd2102d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:36.391519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003207f-dee0-4fcf-9e74-6065dfd2102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:36.424733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d003207f-dee0-4fcf-9e74-6065dfd2102d None None] MFA Rules not processed for user `1b8c22f499404708ab41391eb363ccfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:36.426262 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d003207f-dee0-4fcf-9e74-6065dfd2102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:36.502052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1313/2590] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:36.506452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946aaaa6-53e1-4701-935a-ed170eb02950 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:36.517458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946aaaa6-53e1-4701-935a-ed170eb02950 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:36.522803 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8ca1f-c27b-494b-b7de-06266a707633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:36.523474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8ca1f-c27b-494b-b7de-06266a707633 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:36.523948 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8ca1f-c27b-494b-b7de-06266a707633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:36.524237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8ca1f-c27b-494b-b7de-06266a707633 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:36.525816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8ca1f-c27b-494b-b7de-06266a707633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:36.527890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8ca1f-c27b-494b-b7de-06266a707633 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:36.564569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1278/2591] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:36 2022] POST /identity/v3/projects => generated 374 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:36.568590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003207f-dee0-4fcf-9e74-6065dfd2102d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:36.581218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003207f-dee0-4fcf-9e74-6065dfd2102d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:36.645668 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32509690-defe-4155-85d1-52d699c97f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:36.646349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509690-defe-4155-85d1-52d699c97f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:36.646708 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509690-defe-4155-85d1-52d699c97f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:36.647049 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509690-defe-4155-85d1-52d699c97f8c admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:36.647876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32509690-defe-4155-85d1-52d699c97f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:36.650042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32509690-defe-4155-85d1-52d699c97f8c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:36.673505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1314/2592] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:36 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:33:36.678392 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8ca1f-c27b-494b-b7de-06266a707633 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:36.694302 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8ca1f-c27b-494b-b7de-06266a707633 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:36.701715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda39ef-f94c-4e1e-b7de-4cfc6611ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:36.702297 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda39ef-f94c-4e1e-b7de-4cfc6611ad9f admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:36.702763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda39ef-f94c-4e1e-b7de-4cfc6611ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:36.703215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda39ef-f94c-4e1e-b7de-4cfc6611ad9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:36.704198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda39ef-f94c-4e1e-b7de-4cfc6611ad9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:36.706475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda39ef-f94c-4e1e-b7de-4cfc6611ad9f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:36.731649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1279/2593] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:36 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:36.735953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32509690-defe-4155-85d1-52d699c97f8c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:36.751277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32509690-defe-4155-85d1-52d699c97f8c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:36.758343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713555f-606b-4688-873b-a9a0521fe8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:36.759245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713555f-606b-4688-873b-a9a0521fe8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:36.759526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713555f-606b-4688-873b-a9a0521fe8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:36.759824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713555f-606b-4688-873b-a9a0521fe8a2 admin admin] PATH_INFO: `/v3/projects/6979a63246a14d18a342d5ab8611d480/users/1ea10df1a73c46f594c6ce229edec740/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:36.777447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713555f-606b-4688-873b-a9a0521fe8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6979a63246a14d18a342d5ab8611d480, user_id=1ea10df1a73c46f594c6ce229edec740, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:36.780367 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713555f-606b-4688-873b-a9a0521fe8a2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:36.797906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1315/2594] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:36 2022] PUT /identity/v3/projects/6979a63246a14d18a342d5ab8611d480/users/1ea10df1a73c46f594c6ce229edec740/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:33:36.801892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda39ef-f94c-4e1e-b7de-4cfc6611ad9f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:36.818244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda39ef-f94c-4e1e-b7de-4cfc6611ad9f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:36.890148 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7b36e-b10a-41d0-b147-e0c070d6a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:36.890430 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7b36e-b10a-41d0-b147-e0c070d6a51d admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:36.890669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7b36e-b10a-41d0-b147-e0c070d6a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:36.890933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7b36e-b10a-41d0-b147-e0c070d6a51d admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:36.891698 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7b36e-b10a-41d0-b147-e0c070d6a51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:36.893457 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7b36e-b10a-41d0-b147-e0c070d6a51d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:36.905037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1280/2595] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:36 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:36.909140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713555f-606b-4688-873b-a9a0521fe8a2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:36.920310 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713555f-606b-4688-873b-a9a0521fe8a2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:36.925912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4b22d-0e7e-4b03-a1d9-8510c5869999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:36.926793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b22d-0e7e-4b03-a1d9-8510c5869999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:36.927074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b22d-0e7e-4b03-a1d9-8510c5869999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:36.927350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4b22d-0e7e-4b03-a1d9-8510c5869999 admin admin] PATH_INFO: `/v3/projects/6979a63246a14d18a342d5ab8611d480/users/1ea10df1a73c46f594c6ce229edec740/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:36.936757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4b22d-0e7e-4b03-a1d9-8510c5869999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6979a63246a14d18a342d5ab8611d480, user_id=1ea10df1a73c46f594c6ce229edec740, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:36.939528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4b22d-0e7e-4b03-a1d9-8510c5869999 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:36.955608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1316/2596] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:36 2022] PUT /identity/v3/projects/6979a63246a14d18a342d5ab8611d480/users/1ea10df1a73c46f594c6ce229edec740/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:37.686696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e96cfe-ed5e-44f5-9cba-aa74eac3e415 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:37.687235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e96cfe-ed5e-44f5-9cba-aa74eac3e415 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:37.687335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e96cfe-ed5e-44f5-9cba-aa74eac3e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:37.718361 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-93e96cfe-ed5e-44f5-9cba-aa74eac3e415 None None] MFA Rules not processed for user `1ea10df1a73c46f594c6ce229edec740`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:37.719904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-93e96cfe-ed5e-44f5-9cba-aa74eac3e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:37.805632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1281/2597] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:37.818449 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98abb-617c-4e0b-bcd6-09c881310e50 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:37.819483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98abb-617c-4e0b-bcd6-09c881310e50 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:37.819935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff98abb-617c-4e0b-bcd6-09c881310e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:37.852221 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5ff98abb-617c-4e0b-bcd6-09c881310e50 None None] MFA Rules not processed for user `1b8c22f499404708ab41391eb363ccfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:37.853975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5ff98abb-617c-4e0b-bcd6-09c881310e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:37.876755 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:37.939243 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1317/2598] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:37.950725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e96cfe-ed5e-44f5-9cba-aa74eac3e415 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:37.952490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-93e96cfe-ed5e-44f5-9cba-aa74eac3e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:37.976404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:38.038344 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e96cfe-ed5e-44f5-9cba-aa74eac3e415 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:38.046197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219d75e-3354-492d-8e79-cbb79114def6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:38.047136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219d75e-3354-492d-8e79-cbb79114def6 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:38.047482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219d75e-3354-492d-8e79-cbb79114def6 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:38.047944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219d75e-3354-492d-8e79-cbb79114def6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:38.057119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219d75e-3354-492d-8e79-cbb79114def6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:38.058778 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219d75e-3354-492d-8e79-cbb79114def6 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:38.071198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1282/2599] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:38.120932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff98abb-617c-4e0b-bcd6-09c881310e50 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:38.123847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5ff98abb-617c-4e0b-bcd6-09c881310e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:38.220695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff98abb-617c-4e0b-bcd6-09c881310e50 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:38.228078 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:38.228917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:38.229234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:38.229514 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] PATH_INFO: `/v3/users/bdf91133123a468fbb8297092fd22484` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:38.230811 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf91133123a468fbb8297092fd22484)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:38.232991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:38.285749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf91133123a468fbb8297092fd22484'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.286391 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf91133123a468fbb8297092fd22484'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.293595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf91133123a468fbb8297092fd22484'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.294276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf91133123a468fbb8297092fd22484'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.303037 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b9adb-a23b-4197-b3fb-685e787b01e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf91133123a468fbb8297092fd22484'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.324114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1318/2600] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:38 2022] DELETE /identity/v3/users/bdf91133123a468fbb8297092fd22484 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:38.561554 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219d75e-3354-492d-8e79-cbb79114def6 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:38.573796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219d75e-3354-492d-8e79-cbb79114def6 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:38.636624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:38.637487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:38.637849 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:38.638077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] PATH_INFO: `/v3/projects/c9e5c29c6ed74d94b94555d57e1905db` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:38.639249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e5c29c6ed74d94b94555d57e1905db)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:38.655489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:38.712721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e5c29c6ed74d94b94555d57e1905db', 'request_id': 'req-74330e99-88b6-4b52-977a-6e9ef61b07f4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.723422 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e5c29c6ed74d94b94555d57e1905db', 'request_id': 'req-74330e99-88b6-4b52-977a-6e9ef61b07f4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.734626 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e5c29c6ed74d94b94555d57e1905db', 'request_id': 'req-74330e99-88b6-4b52-977a-6e9ef61b07f4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.757043 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] The token cache is being invalidate because project c9e5c29c6ed74d94b94555d57e1905db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:38.757336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.758010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74330e99-88b6-4b52-977a-6e9ef61b07f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:38.759884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1283/2601] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:38 2022] DELETE /identity/v3/projects/c9e5c29c6ed74d94b94555d57e1905db => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:38.764737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f477c96-92da-4395-8253-1cc559179e77 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:38.765029 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f477c96-92da-4395-8253-1cc559179e77 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:38.765473 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f477c96-92da-4395-8253-1cc559179e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:38.784097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6f477c96-92da-4395-8253-1cc559179e77 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:38.785304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6f477c96-92da-4395-8253-1cc559179e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:38.839880 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:38.861951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1319/2602] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:38.869382 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ff292-b84f-46f2-beb3-280b3db20154 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:38.869674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ff292-b84f-46f2-beb3-280b3db20154 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:38.869966 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ff292-b84f-46f2-beb3-280b3db20154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:38.896822 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-e54ff292-b84f-46f2-beb3-280b3db20154 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:38.898331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e54ff292-b84f-46f2-beb3-280b3db20154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:38.908402 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1284/2603] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:38.912780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f477c96-92da-4395-8253-1cc559179e77 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:38.923717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f477c96-92da-4395-8253-1cc559179e77 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:38.929117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0c189-707a-4f0d-be16-59314187e42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:38.929885 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c189-707a-4f0d-be16-59314187e42d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:38.930250 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c189-707a-4f0d-be16-59314187e42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:38.930836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0c189-707a-4f0d-be16-59314187e42d admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:38.931719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c189-707a-4f0d-be16-59314187e42d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:38.932094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c189-707a-4f0d-be16-59314187e42d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:38.934438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0c189-707a-4f0d-be16-59314187e42d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:38.954761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1320/2604] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:33:38.959752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ff292-b84f-46f2-beb3-280b3db20154 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:38.971502 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ff292-b84f-46f2-beb3-280b3db20154 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:38.977671 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8bc31-0e06-4d80-a022-bb078974d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:38.978773 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8bc31-0e06-4d80-a022-bb078974d76c admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:38.979163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8bc31-0e06-4d80-a022-bb078974d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:38.979706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8bc31-0e06-4d80-a022-bb078974d76c admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:38.980547 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8bc31-0e06-4d80-a022-bb078974d76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:38.983234 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8bc31-0e06-4d80-a022-bb078974d76c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:39.015306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1285/2605] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:38 2022] POST /identity/v3/projects => generated 376 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:39.019528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0c189-707a-4f0d-be16-59314187e42d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:39.030519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0c189-707a-4f0d-be16-59314187e42d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:39.092687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ce426-7110-487b-93a2-2f224cff4f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:39.093537 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ce426-7110-487b-93a2-2f224cff4f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:39.093804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ce426-7110-487b-93a2-2f224cff4f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:39.094051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ce426-7110-487b-93a2-2f224cff4f8c admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:39.094798 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ce426-7110-487b-93a2-2f224cff4f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:39.096763 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ce426-7110-487b-93a2-2f224cff4f8c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:39.118840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1321/2606] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:39 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:33:39.123076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8bc31-0e06-4d80-a022-bb078974d76c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:39.130209 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:39.133955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8bc31-0e06-4d80-a022-bb078974d76c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:39.141973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f180-0988-4324-a300-f871c4d742f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:39.142790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f180-0988-4324-a300-f871c4d742f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:39.143438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f180-0988-4324-a300-f871c4d742f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:39.143807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94f180-0988-4324-a300-f871c4d742f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:39.144815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94f180-0988-4324-a300-f871c4d742f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:39.146476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94f180-0988-4324-a300-f871c4d742f1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:39.158426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1286/2607] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:39 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:33:39.163646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ce426-7110-487b-93a2-2f224cff4f8c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:39.181141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ce426-7110-487b-93a2-2f224cff4f8c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:39.187752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67b34c-2f15-44b0-8361-4d9009e72a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:39.188452 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67b34c-2f15-44b0-8361-4d9009e72a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:39.188743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67b34c-2f15-44b0-8361-4d9009e72a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:39.189017 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67b34c-2f15-44b0-8361-4d9009e72a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:39.190030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67b34c-2f15-44b0-8361-4d9009e72a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:39.191815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67b34c-2f15-44b0-8361-4d9009e72a92 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:39.203085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1322/2608] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:39 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:39.207341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f180-0988-4324-a300-f871c4d742f1 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:39.218877 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94f180-0988-4324-a300-f871c4d742f1 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:39.223810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbacd3-cdf2-47ee-8dca-9552fb3ee9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:39.224725 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbacd3-cdf2-47ee-8dca-9552fb3ee9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:39.225006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbacd3-cdf2-47ee-8dca-9552fb3ee9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:39.225308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbacd3-cdf2-47ee-8dca-9552fb3ee9c0 admin admin] PATH_INFO: `/v3/projects/fabd919773f24c87881bf8a8cc2f0e83/users/8c360c16a56d4b8c8085913632800b07/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:39.241538 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbacd3-cdf2-47ee-8dca-9552fb3ee9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabd919773f24c87881bf8a8cc2f0e83, user_id=8c360c16a56d4b8c8085913632800b07, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:39.245642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbacd3-cdf2-47ee-8dca-9552fb3ee9c0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:39.259139 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1287/2609] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:39 2022] PUT /identity/v3/projects/fabd919773f24c87881bf8a8cc2f0e83/users/8c360c16a56d4b8c8085913632800b07/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:39.270355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdff29-2a1c-43bb-9470-037093b4216b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:39.270648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdff29-2a1c-43bb-9470-037093b4216b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:39.270927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdff29-2a1c-43bb-9470-037093b4216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:39.305701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-47bdff29-2a1c-43bb-9470-037093b4216b None None] MFA Rules not processed for user `8c360c16a56d4b8c8085913632800b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:39.307031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-47bdff29-2a1c-43bb-9470-037093b4216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:39.373778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1323/2610] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:39.384794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbacd3-cdf2-47ee-8dca-9552fb3ee9c0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:39.386498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-07fbacd3-cdf2-47ee-8dca-9552fb3ee9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:39.468310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbacd3-cdf2-47ee-8dca-9552fb3ee9c0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:39.472104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4480c9-e271-49ca-bb48-092a66af8e90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f440bbc0414415186ae83d9fa3842bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:39.472769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4480c9-e271-49ca-bb48-092a66af8e90 service glance] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:39.473051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4480c9-e271-49ca-bb48-092a66af8e90 service glance] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:39.473332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4480c9-e271-49ca-bb48-092a66af8e90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:39.485245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4480c9-e271-49ca-bb48-092a66af8e90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:39.486734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4480c9-e271-49ca-bb48-092a66af8e90 service glance] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:39.497285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1288/2611] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:49.370665 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:49.492458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=48,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:49.871285 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdff29-2a1c-43bb-9470-037093b4216b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:49.872866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-47bdff29-2a1c-43bb-9470-037093b4216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:49.929214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdff29-2a1c-43bb-9470-037093b4216b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:49.933609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fa009-5353-4980-90bb-edf2a4dc1a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:49.934290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa009-5353-4980-90bb-edf2a4dc1a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:49.934578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa009-5353-4980-90bb-edf2a4dc1a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:49.934858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa009-5353-4980-90bb-edf2a4dc1a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:49.936703 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-260fa009-5353-4980-90bb-edf2a4dc1a58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:50.001723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fa009-5353-4980-90bb-edf2a4dc1a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:50.003168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fa009-5353-4980-90bb-edf2a4dc1a58 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:50.013993 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1324/2612] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:54.057963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4480c9-e271-49ca-bb48-092a66af8e90 service glance] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:54.120279 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4480c9-e271-49ca-bb48-092a66af8e90 service glance] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:54.124706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:54.125594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:54.125875 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:54.126153 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] PATH_INFO: `/v3/users/8c360c16a56d4b8c8085913632800b07` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:54.127331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c360c16a56d4b8c8085913632800b07)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:54.129298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:54.174884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c360c16a56d4b8c8085913632800b07'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.175567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c360c16a56d4b8c8085913632800b07'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.187414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c360c16a56d4b8c8085913632800b07'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.194275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c360c16a56d4b8c8085913632800b07'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.194938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c360c16a56d4b8c8085913632800b07'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.208341 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1289/2613] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:33:54 2022] DELETE /identity/v3/users/8c360c16a56d4b8c8085913632800b07 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:54.213288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8336fc-f373-4598-aec0-80fa1e331def None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:54.213799 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8336fc-f373-4598-aec0-80fa1e331def None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:54.213923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8336fc-f373-4598-aec0-80fa1e331def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:54.232006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2b8336fc-f373-4598-aec0-80fa1e331def None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:54.233229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2b8336fc-f373-4598-aec0-80fa1e331def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:54.291301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1325/2614] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:54.301496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:54.302910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:54.362276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce7a43-dc7d-400f-8ca9-4af1115300e5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:54.366020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d3caf-58f2-4676-9137-6b3634d161e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:54.366672 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d3caf-58f2-4676-9137-6b3634d161e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:54.366957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d3caf-58f2-4676-9137-6b3634d161e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:54.367237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d3caf-58f2-4676-9137-6b3634d161e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:54.385316 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d3caf-58f2-4676-9137-6b3634d161e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:54.386790 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d3caf-58f2-4676-9137-6b3634d161e8 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:54.397800 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1290/2615] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:33:54.693753 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8336fc-f373-4598-aec0-80fa1e331def None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:54.695475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2b8336fc-f373-4598-aec0-80fa1e331def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:54.710446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8336fc-f373-4598-aec0-80fa1e331def None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:54.715938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:54.716809 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:54.717845 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:54.718076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] PATH_INFO: `/v3/projects/fabd919773f24c87881bf8a8cc2f0e83` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:54.719526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabd919773f24c87881bf8a8cc2f0e83)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:54.721419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:54.770426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:54.773509 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabd919773f24c87881bf8a8cc2f0e83', 'request_id': 'req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.781409 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabd919773f24c87881bf8a8cc2f0e83', 'request_id': 'req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.789165 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabd919773f24c87881bf8a8cc2f0e83', 'request_id': 'req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.800193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] The token cache is being invalidate because project fabd919773f24c87881bf8a8cc2f0e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:33:54.800414 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.801059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2b3659ee-7e5c-45f1-9aad-dc0d51a34939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:33:54.802600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1326/2616] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:33:54 2022] DELETE /identity/v3/projects/fabd919773f24c87881bf8a8cc2f0e83 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:54.807431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e208f-a81e-43a0-a22c-a69c4eb05ba1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:54.807812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e208f-a81e-43a0-a22c-a69c4eb05ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:54.808051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e208f-a81e-43a0-a22c-a69c4eb05ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:54.825916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-884e208f-a81e-43a0-a22c-a69c4eb05ba1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:54.827687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-884e208f-a81e-43a0-a22c-a69c4eb05ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:54.844909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:33:54.891039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1291/2617] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:54.899171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e26b54-23c8-4ca1-922e-69bb948988ee None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:54.899467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e26b54-23c8-4ca1-922e-69bb948988ee None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:54.899786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e26b54-23c8-4ca1-922e-69bb948988ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:54.919390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-67e26b54-23c8-4ca1-922e-69bb948988ee None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:54.920663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-67e26b54-23c8-4ca1-922e-69bb948988ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:54.928571 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1327/2618] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:54.932931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e208f-a81e-43a0-a22c-a69c4eb05ba1 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:54.942852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e208f-a81e-43a0-a22c-a69c4eb05ba1 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:54.947685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea987f7d-86c1-4a57-b9e1-87e20eec5b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:54.948321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea987f7d-86c1-4a57-b9e1-87e20eec5b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:54.948606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea987f7d-86c1-4a57-b9e1-87e20eec5b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:54.948888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea987f7d-86c1-4a57-b9e1-87e20eec5b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:54.949616 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea987f7d-86c1-4a57-b9e1-87e20eec5b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:33:54.949928 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea987f7d-86c1-4a57-b9e1-87e20eec5b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:54.952101 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea987f7d-86c1-4a57-b9e1-87e20eec5b72 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:54.965614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1292/2619] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:33:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:33:54.970632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e26b54-23c8-4ca1-922e-69bb948988ee None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:54.980465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e26b54-23c8-4ca1-922e-69bb948988ee None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:54.985121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65a1b1-e8d5-445c-a94a-27d3ca9d07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:54.985790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65a1b1-e8d5-445c-a94a-27d3ca9d07aa admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:54.986076 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65a1b1-e8d5-445c-a94a-27d3ca9d07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:54.986353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65a1b1-e8d5-445c-a94a-27d3ca9d07aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:54.987052 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65a1b1-e8d5-445c-a94a-27d3ca9d07aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:54.988998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65a1b1-e8d5-445c-a94a-27d3ca9d07aa admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:55.024418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1328/2620] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:33:54 2022] POST /identity/v3/projects => generated 384 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:55.028639 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea987f7d-86c1-4a57-b9e1-87e20eec5b72 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:55.038944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea987f7d-86c1-4a57-b9e1-87e20eec5b72 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:55.097195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae33b3f-e824-48f0-9be2-fd207e4fb62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:55.097878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae33b3f-e824-48f0-9be2-fd207e4fb62b admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:55.098048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae33b3f-e824-48f0-9be2-fd207e4fb62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:55.098328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae33b3f-e824-48f0-9be2-fd207e4fb62b admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:55.099029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae33b3f-e824-48f0-9be2-fd207e4fb62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:55.101246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae33b3f-e824-48f0-9be2-fd207e4fb62b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:55.120681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1293/2621] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:33:55 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:33:55.125421 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65a1b1-e8d5-445c-a94a-27d3ca9d07aa admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:55.135446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65a1b1-e8d5-445c-a94a-27d3ca9d07aa admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:55.140613 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58b4c0-2c5d-499f-92c1-ce710191f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:55.141254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58b4c0-2c5d-499f-92c1-ce710191f1ff admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:55.141533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58b4c0-2c5d-499f-92c1-ce710191f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:55.141808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58b4c0-2c5d-499f-92c1-ce710191f1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:55.142561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58b4c0-2c5d-499f-92c1-ce710191f1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:55.144169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58b4c0-2c5d-499f-92c1-ce710191f1ff admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:55.154258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1329/2622] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:55 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:55.158092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae33b3f-e824-48f0-9be2-fd207e4fb62b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:55.168107 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae33b3f-e824-48f0-9be2-fd207e4fb62b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:55.172620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9c373-b795-41aa-ad28-984361a885a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:55.173273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c373-b795-41aa-ad28-984361a885a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:55.173551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c373-b795-41aa-ad28-984361a885a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:55.173825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c373-b795-41aa-ad28-984361a885a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:55.174572 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9c373-b795-41aa-ad28-984361a885a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:55.176196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9c373-b795-41aa-ad28-984361a885a0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:55.186721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1294/2623] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:33:55 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:33:55.192406 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58b4c0-2c5d-499f-92c1-ce710191f1ff admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:55.202933 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58b4c0-2c5d-499f-92c1-ce710191f1ff admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:55.207578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bfc7c-f7d9-4520-82e2-80cb130b89d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:55.208450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bfc7c-f7d9-4520-82e2-80cb130b89d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:55.208739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bfc7c-f7d9-4520-82e2-80cb130b89d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:55.209013 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bfc7c-f7d9-4520-82e2-80cb130b89d0 admin admin] PATH_INFO: `/v3/projects/7aea9ec2fcb24f1ebbd86c1d15588716/users/d7ca911139da4a2399c4c770f66d3799/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:55.225246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bfc7c-f7d9-4520-82e2-80cb130b89d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aea9ec2fcb24f1ebbd86c1d15588716, user_id=d7ca911139da4a2399c4c770f66d3799, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:55.228235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bfc7c-f7d9-4520-82e2-80cb130b89d0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:55.241909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1330/2624] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:33:55 2022] PUT /identity/v3/projects/7aea9ec2fcb24f1ebbd86c1d15588716/users/d7ca911139da4a2399c4c770f66d3799/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:33:55.252728 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea777-1ffb-48b2-9665-02d8c092a81a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:55.253015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea777-1ffb-48b2-9665-02d8c092a81a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:55.253294 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ea777-1ffb-48b2-9665-02d8c092a81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:55.280106 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-322ea777-1ffb-48b2-9665-02d8c092a81a None None] MFA Rules not processed for user `d7ca911139da4a2399c4c770f66d3799`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:33:55.281334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-322ea777-1ffb-48b2-9665-02d8c092a81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:55.344590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1295/2625] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:33:55.355717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bfc7c-f7d9-4520-82e2-80cb130b89d0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:33:55.357455 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a54bfc7c-f7d9-4520-82e2-80cb130b89d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:33:55.413162 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bfc7c-f7d9-4520-82e2-80cb130b89d0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:33:55.416858 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dbc04-d21e-46d7-a876-77b969963b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:33:55.417497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dbc04-d21e-46d7-a876-77b969963b3d service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:33:55.417781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dbc04-d21e-46d7-a876-77b969963b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:33:55.418063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dbc04-d21e-46d7-a876-77b969963b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:33:55.426770 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dbc04-d21e-46d7-a876-77b969963b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:33:55.428341 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dbc04-d21e-46d7-a876-77b969963b3d service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:33:55.437617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1331/2626] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:33:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:00.761401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea777-1ffb-48b2-9665-02d8c092a81a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:00.779961 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:00.824173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ea777-1ffb-48b2-9665-02d8c092a81a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:00.829437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:00.830304 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:00.830583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:00.830882 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] PATH_INFO: `/v3/users/d7ca911139da4a2399c4c770f66d3799` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:00.832092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ca911139da4a2399c4c770f66d3799)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:00.834172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:00.884227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ca911139da4a2399c4c770f66d3799'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:00.884890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ca911139da4a2399c4c770f66d3799'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:00.896873 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ca911139da4a2399c4c770f66d3799'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:00.904613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ca911139da4a2399c4c770f66d3799'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:00.905313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ca911139da4a2399c4c770f66d3799'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:00.919383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1296/2627] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:34:00 2022] DELETE /identity/v3/users/d7ca911139da4a2399c4c770f66d3799 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:00.924659 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5704-3da9-40d9-87b8-e4d4b74c3c7e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:00.925159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5704-3da9-40d9-87b8-e4d4b74c3c7e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:00.925258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5704-3da9-40d9-87b8-e4d4b74c3c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:00.944618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a92d5704-3da9-40d9-87b8-e4d4b74c3c7e None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:00.945948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a92d5704-3da9-40d9-87b8-e4d4b74c3c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:01.007967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1332/2628] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:01.017814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:01.019242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:01.086203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc267135-134d-4bfc-9d86-46110071f2dc admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:01.090065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245dfe8-976d-4700-ac6a-abc734d53d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:01.090717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245dfe8-976d-4700-ac6a-abc734d53d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.091003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245dfe8-976d-4700-ac6a-abc734d53d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.091281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245dfe8-976d-4700-ac6a-abc734d53d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.101674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245dfe8-976d-4700-ac6a-abc734d53d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:01.103155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245dfe8-976d-4700-ac6a-abc734d53d65 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:01.113476 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1297/2629] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:01.392680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d5704-3da9-40d9-87b8-e4d4b74c3c7e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:01.394405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a92d5704-3da9-40d9-87b8-e4d4b74c3c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:01.403340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:01.408233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d5704-3da9-40d9-87b8-e4d4b74c3c7e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:01.418100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:01.419031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.419759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.420701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] PATH_INFO: `/v3/projects/7aea9ec2fcb24f1ebbd86c1d15588716` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.422966 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aea9ec2fcb24f1ebbd86c1d15588716)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:01.425899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:01.481467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aea9ec2fcb24f1ebbd86c1d15588716', 'request_id': 'req-61cbf142-de5c-48d2-abc3-d0e84457d797'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:01.481897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aea9ec2fcb24f1ebbd86c1d15588716', 'request_id': 'req-61cbf142-de5c-48d2-abc3-d0e84457d797'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:01.489618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aea9ec2fcb24f1ebbd86c1d15588716', 'request_id': 'req-61cbf142-de5c-48d2-abc3-d0e84457d797'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:01.500293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] The token cache is being invalidate because project 7aea9ec2fcb24f1ebbd86c1d15588716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:34:01.500587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:01.501245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-61cbf142-de5c-48d2-abc3-d0e84457d797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:01.503276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1333/2630] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:34:01 2022] DELETE /identity/v3/projects/7aea9ec2fcb24f1ebbd86c1d15588716 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:01.510047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b30dd0-d270-434f-85f2-b2b2d0fda047 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.510475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b30dd0-d270-434f-85f2-b2b2d0fda047 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.510762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b30dd0-d270-434f-85f2-b2b2d0fda047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.530327 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c0b30dd0-d270-434f-85f2-b2b2d0fda047 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:01.531602 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c0b30dd0-d270-434f-85f2-b2b2d0fda047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:01.569918 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:01.601530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1298/2631] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:01.609435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e383a3-b6d7-45cd-b16f-1d5ccd48c741 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.609719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e383a3-b6d7-45cd-b16f-1d5ccd48c741 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.609998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e383a3-b6d7-45cd-b16f-1d5ccd48c741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.638030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-35e383a3-b6d7-45cd-b16f-1d5ccd48c741 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:01.639832 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-35e383a3-b6d7-45cd-b16f-1d5ccd48c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:01.648438 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1334/2632] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:01.653135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b30dd0-d270-434f-85f2-b2b2d0fda047 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:01.663998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b30dd0-d270-434f-85f2-b2b2d0fda047 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:01.670531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6168c56-3c0e-4988-8f9e-7b2d84dbf190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:01.671210 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6168c56-3c0e-4988-8f9e-7b2d84dbf190 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.671491 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6168c56-3c0e-4988-8f9e-7b2d84dbf190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.671802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6168c56-3c0e-4988-8f9e-7b2d84dbf190 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.672544 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6168c56-3c0e-4988-8f9e-7b2d84dbf190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:34:01.672857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6168c56-3c0e-4988-8f9e-7b2d84dbf190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:01.674501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6168c56-3c0e-4988-8f9e-7b2d84dbf190 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:01.687610 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1299/2633] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:34:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:34:01.692903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e383a3-b6d7-45cd-b16f-1d5ccd48c741 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:01.702772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e383a3-b6d7-45cd-b16f-1d5ccd48c741 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:01.707581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996f8e5-1c79-4f38-bc68-b83aaf000d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:01.708256 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996f8e5-1c79-4f38-bc68-b83aaf000d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.708545 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996f8e5-1c79-4f38-bc68-b83aaf000d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.708822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996f8e5-1c79-4f38-bc68-b83aaf000d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.709529 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996f8e5-1c79-4f38-bc68-b83aaf000d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:01.711583 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996f8e5-1c79-4f38-bc68-b83aaf000d9c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:01.743431 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1335/2634] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:34:01 2022] POST /identity/v3/projects => generated 370 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:34:01.744613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6168c56-3c0e-4988-8f9e-7b2d84dbf190 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:01.755609 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6168c56-3c0e-4988-8f9e-7b2d84dbf190 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:01.816668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd01afc-e00d-46ec-a874-ce9feff3cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:01.817421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd01afc-e00d-46ec-a874-ce9feff3cac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.817696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd01afc-e00d-46ec-a874-ce9feff3cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.817892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd01afc-e00d-46ec-a874-ce9feff3cac3 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.818613 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd01afc-e00d-46ec-a874-ce9feff3cac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:01.822482 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd01afc-e00d-46ec-a874-ce9feff3cac3 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:01.844177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1300/2635] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:34:01 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:34:01.848299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996f8e5-1c79-4f38-bc68-b83aaf000d9c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:01.858968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996f8e5-1c79-4f38-bc68-b83aaf000d9c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:01.863678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537d72b-69b9-4348-95de-d3a91af6bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:01.864335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d72b-69b9-4348-95de-d3a91af6bad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.864622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d72b-69b9-4348-95de-d3a91af6bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.864902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537d72b-69b9-4348-95de-d3a91af6bad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.865633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537d72b-69b9-4348-95de-d3a91af6bad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:01.867335 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537d72b-69b9-4348-95de-d3a91af6bad4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:01.878370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1336/2636] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:34:01 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:34:01.882283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd01afc-e00d-46ec-a874-ce9feff3cac3 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:01.893094 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd01afc-e00d-46ec-a874-ce9feff3cac3 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:01.897756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e2811-d76f-4599-828f-2f76bbc00578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:01.898412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e2811-d76f-4599-828f-2f76bbc00578 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.898699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e2811-d76f-4599-828f-2f76bbc00578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.898975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e2811-d76f-4599-828f-2f76bbc00578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.899733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e2811-d76f-4599-828f-2f76bbc00578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:01.901328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e2811-d76f-4599-828f-2f76bbc00578 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:01.911454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1301/2637] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:34:01 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:34:01.915695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537d72b-69b9-4348-95de-d3a91af6bad4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:01.925822 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537d72b-69b9-4348-95de-d3a91af6bad4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:01.930549 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498c615-5aca-4e10-a563-71560ebe1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:01.931444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c615-5aca-4e10-a563-71560ebe1218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.931784 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c615-5aca-4e10-a563-71560ebe1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.932032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498c615-5aca-4e10-a563-71560ebe1218 admin admin] PATH_INFO: `/v3/projects/bec77cc8ef7b4b0ab2c035915ae4709a/users/db13b893c01f46ca93a6ff0da99231c5/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:01.949024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498c615-5aca-4e10-a563-71560ebe1218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec77cc8ef7b4b0ab2c035915ae4709a, user_id=db13b893c01f46ca93a6ff0da99231c5, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:01.952324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498c615-5aca-4e10-a563-71560ebe1218 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:01.966741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1337/2638] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:34:01 2022] PUT /identity/v3/projects/bec77cc8ef7b4b0ab2c035915ae4709a/users/db13b893c01f46ca93a6ff0da99231c5/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:01.978550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52719ce-c038-49c2-b142-4b5c06a0ca54 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:01.978958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52719ce-c038-49c2-b142-4b5c06a0ca54 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:01.979446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52719ce-c038-49c2-b142-4b5c06a0ca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:02.007711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f52719ce-c038-49c2-b142-4b5c06a0ca54 None None] MFA Rules not processed for user `db13b893c01f46ca93a6ff0da99231c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:02.008854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f52719ce-c038-49c2-b142-4b5c06a0ca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:02.080756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1302/2639] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:02.092020 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498c615-5aca-4e10-a563-71560ebe1218 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:02.093742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a498c615-5aca-4e10-a563-71560ebe1218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:02.167004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498c615-5aca-4e10-a563-71560ebe1218 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:02.179947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bc494-a1f7-4f76-90cc-1cff6246d889 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f440bbc0414415186ae83d9fa3842bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:02.180762 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bc494-a1f7-4f76-90cc-1cff6246d889 service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:02.181053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bc494-a1f7-4f76-90cc-1cff6246d889 service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:02.181333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bc494-a1f7-4f76-90cc-1cff6246d889 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:02.192330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bc494-a1f7-4f76-90cc-1cff6246d889 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:02.194099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bc494-a1f7-4f76-90cc-1cff6246d889 service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:02.204519 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1338/2640] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:09.532523 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52719ce-c038-49c2-b142-4b5c06a0ca54 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:09.534676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f52719ce-c038-49c2-b142-4b5c06a0ca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:09.598478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:09.645632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52719ce-c038-49c2-b142-4b5c06a0ca54 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:09.659010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7590db-8f79-4c57-b01a-61715f2d5202 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:09.659010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7590db-8f79-4c57-b01a-61715f2d5202 service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:09.659010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7590db-8f79-4c57-b01a-61715f2d5202 service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:09.659010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7590db-8f79-4c57-b01a-61715f2d5202 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:09.668674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fc7590db-8f79-4c57-b01a-61715f2d5202 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:09.682745 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7590db-8f79-4c57-b01a-61715f2d5202 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:09.686732 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7590db-8f79-4c57-b01a-61715f2d5202 service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:09.696955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1303/2641] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:10.589273 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bc494-a1f7-4f76-90cc-1cff6246d889 service glance] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:10.591022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-db0bc494-a1f7-4f76-90cc-1cff6246d889 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:10.629453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:10.669270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bc494-a1f7-4f76-90cc-1cff6246d889 service glance] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:10.674775 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:10.676012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:10.676184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:10.680293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] PATH_INFO: `/v3/users/1b8c22f499404708ab41391eb363ccfb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:10.680293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8c22f499404708ab41391eb363ccfb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:10.681268 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:10.735349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8c22f499404708ab41391eb363ccfb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:10.736492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8c22f499404708ab41391eb363ccfb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:10.751626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8c22f499404708ab41391eb363ccfb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:10.752388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8c22f499404708ab41391eb363ccfb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:10.760497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8c22f499404708ab41391eb363ccfb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:10.778615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1339/2642] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:34:10 2022] DELETE /identity/v3/users/1b8c22f499404708ab41391eb363ccfb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:11.014224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7590db-8f79-4c57-b01a-61715f2d5202 service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:11.030405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7590db-8f79-4c57-b01a-61715f2d5202 service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:11.124192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:11.125301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:11.125851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:11.126105 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] PATH_INFO: `/v3/projects/5abb91c423c94f359f8e20b42d1be855` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:11.128187 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abb91c423c94f359f8e20b42d1be855)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:11.133531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:11.197283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abb91c423c94f359f8e20b42d1be855', 'request_id': 'req-6f888756-8d8d-4e18-b40c-4d841f43bf1e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.215831 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abb91c423c94f359f8e20b42d1be855', 'request_id': 'req-6f888756-8d8d-4e18-b40c-4d841f43bf1e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.236027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abb91c423c94f359f8e20b42d1be855', 'request_id': 'req-6f888756-8d8d-4e18-b40c-4d841f43bf1e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.270163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] The token cache is being invalidate because project 5abb91c423c94f359f8e20b42d1be855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:34:11.270474 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.271191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.272823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1304/2643] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:34:11 2022] DELETE /identity/v3/projects/5abb91c423c94f359f8e20b42d1be855 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:11.276758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:11.278206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:11.298217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71111de-51f4-466c-8ca7-a14805baf049 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:11.397725 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:11.399125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:11.399454 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:11.399860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] PATH_INFO: `/v3/users/1ea10df1a73c46f594c6ce229edec740` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:11.401229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea10df1a73c46f594c6ce229edec740)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:11.403618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:11.496100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea10df1a73c46f594c6ce229edec740'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.497107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea10df1a73c46f594c6ce229edec740'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.511692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:11.537650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea10df1a73c46f594c6ce229edec740'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.540366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea10df1a73c46f594c6ce229edec740'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.563296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b032b3c0-c919-4603-8ef9-460516005894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea10df1a73c46f594c6ce229edec740'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:11.600470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1340/2644] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:34:11 2022] DELETE /identity/v3/users/1ea10df1a73c46f594c6ce229edec740 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:11.945881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:11.947686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:11.972844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f888756-8d8d-4e18-b40c-4d841f43bf1e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:12.053330 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:12.070072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:12.071075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.071376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.072095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] PATH_INFO: `/v3/projects/6979a63246a14d18a342d5ab8611d480` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.074519 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6979a63246a14d18a342d5ab8611d480)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:12.077561 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:12.143718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6979a63246a14d18a342d5ab8611d480', 'request_id': 'req-bf6bba57-fe90-4a87-a909-1ed00d3dc606'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:12.153644 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6979a63246a14d18a342d5ab8611d480', 'request_id': 'req-bf6bba57-fe90-4a87-a909-1ed00d3dc606'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:12.169623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6979a63246a14d18a342d5ab8611d480', 'request_id': 'req-bf6bba57-fe90-4a87-a909-1ed00d3dc606'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:12.193151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] The token cache is being invalidate because project 6979a63246a14d18a342d5ab8611d480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:34:12.193571 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:12.194371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-bf6bba57-fe90-4a87-a909-1ed00d3dc606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:12.196618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1305/2645] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:34:11 2022] DELETE /identity/v3/projects/6979a63246a14d18a342d5ab8611d480 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:12.202150 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ade8f-7cc5-4286-8538-7bdcdeea9245 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.202533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ade8f-7cc5-4286-8538-7bdcdeea9245 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.202956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ade8f-7cc5-4286-8538-7bdcdeea9245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.223952 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-119ade8f-7cc5-4286-8538-7bdcdeea9245 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:12.225180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-119ade8f-7cc5-4286-8538-7bdcdeea9245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:12.309027 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1341/2646] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:12.320583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097e6e-98b3-4c21-8efe-e947ab48502f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.320583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097e6e-98b3-4c21-8efe-e947ab48502f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.320583 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097e6e-98b3-4c21-8efe-e947ab48502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.344768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-b9097e6e-98b3-4c21-8efe-e947ab48502f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:12.347078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b9097e6e-98b3-4c21-8efe-e947ab48502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:12.360443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1306/2647] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:12.361670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ade8f-7cc5-4286-8538-7bdcdeea9245 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:12.371711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ade8f-7cc5-4286-8538-7bdcdeea9245 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:12.377122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7909-cc4b-4cd6-999a-8192306a78f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:12.377776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7909-cc4b-4cd6-999a-8192306a78f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.378055 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7909-cc4b-4cd6-999a-8192306a78f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.378329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab7909-cc4b-4cd6-999a-8192306a78f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.379051 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab7909-cc4b-4cd6-999a-8192306a78f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:34:12.379380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab7909-cc4b-4cd6-999a-8192306a78f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:12.380978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab7909-cc4b-4cd6-999a-8192306a78f9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:12.401155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1342/2648] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:34:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:34:12.401990 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097e6e-98b3-4c21-8efe-e947ab48502f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:12.411770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097e6e-98b3-4c21-8efe-e947ab48502f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:12.417949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1b4e-6d7f-4a3b-91c8-779365779e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:12.418999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1b4e-6d7f-4a3b-91c8-779365779e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.419470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1b4e-6d7f-4a3b-91c8-779365779e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.420073 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1b4e-6d7f-4a3b-91c8-779365779e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.421420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d1b4e-6d7f-4a3b-91c8-779365779e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:12.423478 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d1b4e-6d7f-4a3b-91c8-779365779e8a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:12.458346 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1307/2649] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:34:12 2022] POST /identity/v3/projects => generated 382 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:34:12.463585 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7909-cc4b-4cd6-999a-8192306a78f9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:12.474898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab7909-cc4b-4cd6-999a-8192306a78f9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:12.548030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70fa07-14bf-4357-93fe-7e500348c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:12.548713 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70fa07-14bf-4357-93fe-7e500348c480 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.549105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70fa07-14bf-4357-93fe-7e500348c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.549346 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70fa07-14bf-4357-93fe-7e500348c480 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.550219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70fa07-14bf-4357-93fe-7e500348c480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:12.552450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70fa07-14bf-4357-93fe-7e500348c480 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:12.579614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1343/2650] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:34:12 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:34:12.581687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1b4e-6d7f-4a3b-91c8-779365779e8a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:12.584024 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07a891-7f0b-4d1f-a140-e43598d96fde None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.584482 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07a891-7f0b-4d1f-a140-e43598d96fde None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.584945 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07a891-7f0b-4d1f-a140-e43598d96fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.592979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1b4e-6d7f-4a3b-91c8-779365779e8a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:12.610559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2f2c0-b464-4679-b6f2-bdc90c37c9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:12.611269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2f2c0-b464-4679-b6f2-bdc90c37c9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.611706 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2f2c0-b464-4679-b6f2-bdc90c37c9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.611985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2f2c0-b464-4679-b6f2-bdc90c37c9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.612729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2f2c0-b464-4679-b6f2-bdc90c37c9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:12.612913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0c07a891-7f0b-4d1f-a140-e43598d96fde None None] MFA Rules not processed for user `435fe25611c8486e81afae7e81e2aa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:12.614396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2f2c0-b464-4679-b6f2-bdc90c37c9ba admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:12.614828 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0c07a891-7f0b-4d1f-a140-e43598d96fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:12.627042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1308/2651] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:34:12 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:34:12.631205 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2f2c0-b464-4679-b6f2-bdc90c37c9ba admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:12.641420 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2f2c0-b464-4679-b6f2-bdc90c37c9ba admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:12.655240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242279d-f60c-471c-a669-436392f2d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:12.655965 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242279d-f60c-471c-a669-436392f2d6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.656264 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242279d-f60c-471c-a669-436392f2d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.656539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242279d-f60c-471c-a669-436392f2d6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.657260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242279d-f60c-471c-a669-436392f2d6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:12.657749 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:12.672605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242279d-f60c-471c-a669-436392f2d6fd admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:12.683597 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1344/2652] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:34:12.684045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1309/2653] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:34:12 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:34:12.688526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07a891-7f0b-4d1f-a140-e43598d96fde None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:12.702787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07a891-7f0b-4d1f-a140-e43598d96fde None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:12.718364 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ea067-3fbe-42f3-a6a7-4b4127065901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:12.719501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ea067-3fbe-42f3-a6a7-4b4127065901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.719896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ea067-3fbe-42f3-a6a7-4b4127065901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.721098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ea067-3fbe-42f3-a6a7-4b4127065901 admin admin] PATH_INFO: `/v3/projects/430b36a5248f4263b679e1212fa28e9e/users/c62dc3af789a46f08c95455f5fd8da54/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.739070 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ea067-3fbe-42f3-a6a7-4b4127065901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430b36a5248f4263b679e1212fa28e9e, user_id=c62dc3af789a46f08c95455f5fd8da54, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:12.742189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ea067-3fbe-42f3-a6a7-4b4127065901 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:12.758353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1345/2654] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:34:12 2022] PUT /identity/v3/projects/430b36a5248f4263b679e1212fa28e9e/users/c62dc3af789a46f08c95455f5fd8da54/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:34:12.769231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cea64-ea34-4f88-9464-de3d9e986058 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.769553 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cea64-ea34-4f88-9464-de3d9e986058 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.769836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cea64-ea34-4f88-9464-de3d9e986058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.800450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-c24cea64-ea34-4f88-9464-de3d9e986058 None None] MFA Rules not processed for user `c62dc3af789a46f08c95455f5fd8da54`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:12.801715 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c24cea64-ea34-4f88-9464-de3d9e986058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:12.883941 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1310/2655] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:12.895345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ea067-3fbe-42f3-a6a7-4b4127065901 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:12.897140 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b98ea067-3fbe-42f3-a6a7-4b4127065901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:12.967372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ea067-3fbe-42f3-a6a7-4b4127065901 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:12.971158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b45aa4-5734-4afe-921b-3434ebfcdf9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:12.971867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b45aa4-5734-4afe-921b-3434ebfcdf9b service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:12.972184 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b45aa4-5734-4afe-921b-3434ebfcdf9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:12.972417 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b45aa4-5734-4afe-921b-3434ebfcdf9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:12.984722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b45aa4-5734-4afe-921b-3434ebfcdf9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:12.987900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b45aa4-5734-4afe-921b-3434ebfcdf9b service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:13.004468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1346/2656] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:13.026776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cea64-ea34-4f88-9464-de3d9e986058 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:13.060801 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:13.108821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cea64-ea34-4f88-9464-de3d9e986058 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:13.114444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:13.115345 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:13.115659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:13.115930 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] PATH_INFO: `/v3/users/c62dc3af789a46f08c95455f5fd8da54` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:13.117185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62dc3af789a46f08c95455f5fd8da54)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:13.119189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:13.187239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62dc3af789a46f08c95455f5fd8da54'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.187973 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62dc3af789a46f08c95455f5fd8da54'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.202964 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62dc3af789a46f08c95455f5fd8da54'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.228160 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62dc3af789a46f08c95455f5fd8da54'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.228957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62dc3af789a46f08c95455f5fd8da54'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.246568 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1311/2657] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:34:13 2022] DELETE /identity/v3/users/c62dc3af789a46f08c95455f5fd8da54 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:13.251574 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498b75-a75c-483c-b5af-2afcd58b2a80 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:13.251975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498b75-a75c-483c-b5af-2afcd58b2a80 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:13.252378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498b75-a75c-483c-b5af-2afcd58b2a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:13.274219 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-aa498b75-a75c-483c-b5af-2afcd58b2a80 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:13.275470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aa498b75-a75c-483c-b5af-2afcd58b2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:13.353948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1347/2658] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:13.366870 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:13.368368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:13.478448 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9c3f9-5320-492b-8067-d4318192cf77 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:13.483941 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b89d1-4e0f-4140-9c32-926bb3dd408e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:13.484838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b89d1-4e0f-4140-9c32-926bb3dd408e service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:13.485281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b89d1-4e0f-4140-9c32-926bb3dd408e service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:13.485712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b89d1-4e0f-4140-9c32-926bb3dd408e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:13.499887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b89d1-4e0f-4140-9c32-926bb3dd408e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:13.502195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b89d1-4e0f-4140-9c32-926bb3dd408e service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:13.517192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1312/2659] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:13.832525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498b75-a75c-483c-b5af-2afcd58b2a80 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:13.834797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aa498b75-a75c-483c-b5af-2afcd58b2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:13.851866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498b75-a75c-483c-b5af-2afcd58b2a80 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:13.859493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:13.860987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:13.861478 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:13.874301 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] PATH_INFO: `/v3/projects/430b36a5248f4263b679e1212fa28e9e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:13.877428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430b36a5248f4263b679e1212fa28e9e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:13.879774 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:13.963152 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430b36a5248f4263b679e1212fa28e9e', 'request_id': 'req-2923328e-2e15-44fd-84da-6f88febc1007'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.971401 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430b36a5248f4263b679e1212fa28e9e', 'request_id': 'req-2923328e-2e15-44fd-84da-6f88febc1007'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.980176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430b36a5248f4263b679e1212fa28e9e', 'request_id': 'req-2923328e-2e15-44fd-84da-6f88febc1007'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.982041 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:13.994738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] The token cache is being invalidate because project 430b36a5248f4263b679e1212fa28e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:34:13.995420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.996397 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2923328e-2e15-44fd-84da-6f88febc1007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:13.998180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1348/2660] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:34:13 2022] DELETE /identity/v3/projects/430b36a5248f4263b679e1212fa28e9e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:14.003123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6454e-f5a6-4c87-842c-a3fdce301f35 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.003437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6454e-f5a6-4c87-842c-a3fdce301f35 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.003738 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6454e-f5a6-4c87-842c-a3fdce301f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.022879 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-0cd6454e-f5a6-4c87-842c-a3fdce301f35 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:14.024456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0cd6454e-f5a6-4c87-842c-a3fdce301f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:14.074564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:14.103922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1313/2661] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:14.111932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b5fc1-655a-4822-9968-e952949eacc6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.112459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b5fc1-655a-4822-9968-e952949eacc6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.112919 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b5fc1-655a-4822-9968-e952949eacc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.135696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9c1b5fc1-655a-4822-9968-e952949eacc6 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:14.136900 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9c1b5fc1-655a-4822-9968-e952949eacc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:14.146469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1349/2662] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:14.151771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6454e-f5a6-4c87-842c-a3fdce301f35 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:14.165767 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6454e-f5a6-4c87-842c-a3fdce301f35 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:14.171247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e711a3-e02a-444e-908a-022fd888a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:14.171971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e711a3-e02a-444e-908a-022fd888a525 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.172263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e711a3-e02a-444e-908a-022fd888a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.172543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e711a3-e02a-444e-908a-022fd888a525 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.173394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e711a3-e02a-444e-908a-022fd888a525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:34:14.173702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e711a3-e02a-444e-908a-022fd888a525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:14.175369 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e711a3-e02a-444e-908a-022fd888a525 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:14.193307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1314/2663] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:34:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:34:14.194791 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b5fc1-655a-4822-9968-e952949eacc6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:14.205077 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b5fc1-655a-4822-9968-e952949eacc6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:14.213014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13146fbd-95f7-4a30-a573-3213b54b6979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:14.213700 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13146fbd-95f7-4a30-a573-3213b54b6979 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.213976 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13146fbd-95f7-4a30-a573-3213b54b6979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.214259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13146fbd-95f7-4a30-a573-3213b54b6979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.214948 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13146fbd-95f7-4a30-a573-3213b54b6979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:14.217493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13146fbd-95f7-4a30-a573-3213b54b6979 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:14.247855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1350/2664] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:34:14 2022] POST /identity/v3/projects => generated 376 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:34:14.252400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e711a3-e02a-444e-908a-022fd888a525 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:14.265054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e711a3-e02a-444e-908a-022fd888a525 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:14.327207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1789-6e1f-4b11-b202-fbb0ce6a58cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:14.327980 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1789-6e1f-4b11-b202-fbb0ce6a58cf admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.328265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1789-6e1f-4b11-b202-fbb0ce6a58cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.328540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1789-6e1f-4b11-b202-fbb0ce6a58cf admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.329258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad1789-6e1f-4b11-b202-fbb0ce6a58cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:14.331207 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad1789-6e1f-4b11-b202-fbb0ce6a58cf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:14.356848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1315/2665] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:34:14 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:34:14.358877 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13146fbd-95f7-4a30-a573-3213b54b6979 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:14.370282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13146fbd-95f7-4a30-a573-3213b54b6979 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:14.375667 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f0a36-fbfa-4b89-8bd4-99f2be1cd173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:14.376344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f0a36-fbfa-4b89-8bd4-99f2be1cd173 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.376633 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f0a36-fbfa-4b89-8bd4-99f2be1cd173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.376918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f0a36-fbfa-4b89-8bd4-99f2be1cd173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.377690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f0a36-fbfa-4b89-8bd4-99f2be1cd173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:14.379324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f0a36-fbfa-4b89-8bd4-99f2be1cd173 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:14.391353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1351/2666] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:34:14 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:34:14.396024 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1789-6e1f-4b11-b202-fbb0ce6a58cf admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:14.412282 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1789-6e1f-4b11-b202-fbb0ce6a58cf admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:14.417496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81b072-c930-4249-ad1f-295884819750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:14.418179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b072-c930-4249-ad1f-295884819750 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.418604 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b072-c930-4249-ad1f-295884819750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.418895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81b072-c930-4249-ad1f-295884819750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.419683 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81b072-c930-4249-ad1f-295884819750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:14.421925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81b072-c930-4249-ad1f-295884819750 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:14.437181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1316/2667] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:34:14 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:34:14.438460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f0a36-fbfa-4b89-8bd4-99f2be1cd173 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:14.455381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f0a36-fbfa-4b89-8bd4-99f2be1cd173 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:14.465557 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e178f-585f-4a00-8c4b-296cba24cbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:14.466685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e178f-585f-4a00-8c4b-296cba24cbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.467053 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e178f-585f-4a00-8c4b-296cba24cbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.467399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e178f-585f-4a00-8c4b-296cba24cbbc admin admin] PATH_INFO: `/v3/projects/0c542f66c8f14b5ab1b6a870008256ff/users/b60986ff8bc24ede8d20ba9255057311/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.487600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e178f-585f-4a00-8c4b-296cba24cbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c542f66c8f14b5ab1b6a870008256ff, user_id=b60986ff8bc24ede8d20ba9255057311, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:14.490840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e178f-585f-4a00-8c4b-296cba24cbbc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:14.526424 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1352/2668] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:34:14 2022] PUT /identity/v3/projects/0c542f66c8f14b5ab1b6a870008256ff/users/b60986ff8bc24ede8d20ba9255057311/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:14.529510 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fe049-f063-4c1c-be1c-f531e1e165ba None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.530449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fe049-f063-4c1c-be1c-f531e1e165ba None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.530449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fe049-f063-4c1c-be1c-f531e1e165ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.562020 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5d6fe049-f063-4c1c-be1c-f531e1e165ba None None] MFA Rules not processed for user `b60986ff8bc24ede8d20ba9255057311`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:14.563295 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5d6fe049-f063-4c1c-be1c-f531e1e165ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:14.663147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1317/2669] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:14.674304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e178f-585f-4a00-8c4b-296cba24cbbc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:14.676302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fe3e178f-585f-4a00-8c4b-296cba24cbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:14.733056 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e178f-585f-4a00-8c4b-296cba24cbbc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:14.736842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d084-266b-46c8-8854-e7138e8d1b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:14.737573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d084-266b-46c8-8854-e7138e8d1b19 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:14.737745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d084-266b-46c8-8854-e7138e8d1b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:14.738023 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d084-266b-46c8-8854-e7138e8d1b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:14.746209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d084-266b-46c8-8854-e7138e8d1b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:14.748212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d084-266b-46c8-8854-e7138e8d1b19 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:14.757204 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1353/2670] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:15.971439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fe049-f063-4c1c-be1c-f531e1e165ba None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:15.973056 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5d6fe049-f063-4c1c-be1c-f531e1e165ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:16.024438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:16.042055 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fe049-f063-4c1c-be1c-f531e1e165ba None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:16.047337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c02367-fbf0-4e81-b029-9caa4da8a9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:16.048117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02367-fbf0-4e81-b029-9caa4da8a9eb service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:16.048407 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02367-fbf0-4e81-b029-9caa4da8a9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:16.048688 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02367-fbf0-4e81-b029-9caa4da8a9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:16.050988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f7c02367-fbf0-4e81-b029-9caa4da8a9eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:16.147624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c02367-fbf0-4e81-b029-9caa4da8a9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:16.149301 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c02367-fbf0-4e81-b029-9caa4da8a9eb service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:16.174483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1318/2671] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:18.000588 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d084-266b-46c8-8854-e7138e8d1b19 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:18.011760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d084-266b-46c8-8854-e7138e8d1b19 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:18.017729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:18.019648 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:18.020114 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:18.020561 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] PATH_INFO: `/v3/users/b60986ff8bc24ede8d20ba9255057311` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:18.022121 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60986ff8bc24ede8d20ba9255057311)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:18.024278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:18.085826 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60986ff8bc24ede8d20ba9255057311'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.087151 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60986ff8bc24ede8d20ba9255057311'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.094870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60986ff8bc24ede8d20ba9255057311'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.095691 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60986ff8bc24ede8d20ba9255057311'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.106814 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60986ff8bc24ede8d20ba9255057311'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.120601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:18.125761 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1354/2672] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:34:17 2022] DELETE /identity/v3/users/b60986ff8bc24ede8d20ba9255057311 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:18.131143 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa31d-66f0-422d-908b-57d76e773f77 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:18.131712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa31d-66f0-422d-908b-57d76e773f77 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:18.131812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa31d-66f0-422d-908b-57d76e773f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:18.151101 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fa0aa31d-66f0-422d-908b-57d76e773f77 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:18.152393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fa0aa31d-66f0-422d-908b-57d76e773f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:18.246195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1319/2673] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:18.253475 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:18.255020 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:18.344153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d59222-79b8-4610-9d1d-a2e0e1fddfc4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:18.349387 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ec171-e466-4a9a-808c-17f3081d616a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:18.350912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ec171-e466-4a9a-808c-17f3081d616a service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:18.351272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ec171-e466-4a9a-808c-17f3081d616a service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:18.352012 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ec171-e466-4a9a-808c-17f3081d616a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:18.370717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ec171-e466-4a9a-808c-17f3081d616a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:18.373905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ec171-e466-4a9a-808c-17f3081d616a service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:18.403593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1355/2674] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:18.798773 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aa31d-66f0-422d-908b-57d76e773f77 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:18.800880 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fa0aa31d-66f0-422d-908b-57d76e773f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:18.821191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aa31d-66f0-422d-908b-57d76e773f77 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:18.827095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:18.827939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:18.828299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:18.828653 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] PATH_INFO: `/v3/projects/0c542f66c8f14b5ab1b6a870008256ff` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:18.830649 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c542f66c8f14b5ab1b6a870008256ff)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:18.833605 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:18.902536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c542f66c8f14b5ab1b6a870008256ff', 'request_id': 'req-9d838398-03ba-4d9b-9b39-65074e0617c9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.910776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c542f66c8f14b5ab1b6a870008256ff', 'request_id': 'req-9d838398-03ba-4d9b-9b39-65074e0617c9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.921764 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c542f66c8f14b5ab1b6a870008256ff', 'request_id': 'req-9d838398-03ba-4d9b-9b39-65074e0617c9'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.947901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] The token cache is being invalidate because project 0c542f66c8f14b5ab1b6a870008256ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:34:18.950021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.951424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:18.954029 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1320/2675] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:34:18 2022] DELETE /identity/v3/projects/0c542f66c8f14b5ab1b6a870008256ff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:23.250834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ec171-e466-4a9a-808c-17f3081d616a service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:23.251806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-658ec171-e466-4a9a-808c-17f3081d616a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:23.264888 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ec171-e466-4a9a-808c-17f3081d616a service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:23.326534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:23.327513 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:23.327913 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:23.328251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] PATH_INFO: `/v3/users/fd48b33d8d974d5eb0d53e5959bb4c42` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:23.329540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd48b33d8d974d5eb0d53e5959bb4c42)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:23.331540 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:23.382172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd48b33d8d974d5eb0d53e5959bb4c42'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.382860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd48b33d8d974d5eb0d53e5959bb4c42'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.390523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd48b33d8d974d5eb0d53e5959bb4c42'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.391384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd48b33d8d974d5eb0d53e5959bb4c42'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.400179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd48b33d8d974d5eb0d53e5959bb4c42'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.420987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1356/2676] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:34:23 2022] DELETE /identity/v3/users/fd48b33d8d974d5eb0d53e5959bb4c42 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:23.669070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:23.671125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:23.695004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838398-03ba-4d9b-9b39-65074e0617c9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:23.707960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:23.761559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:23.762592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:23.763089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:23.763573 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] PATH_INFO: `/v3/projects/11159f096f0b4ba68579c7d26b5178b9` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:23.765277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11159f096f0b4ba68579c7d26b5178b9)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:23.767227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:23.836734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11159f096f0b4ba68579c7d26b5178b9', 'request_id': 'req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.845257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11159f096f0b4ba68579c7d26b5178b9', 'request_id': 'req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.855222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11159f096f0b4ba68579c7d26b5178b9', 'request_id': 'req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.868846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] The token cache is being invalidate because project 11159f096f0b4ba68579c7d26b5178b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:34:23.869140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.869807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:23.874906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1321/2677] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:34:23 2022] DELETE /identity/v3/projects/11159f096f0b4ba68579c7d26b5178b9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:23.876229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:23.878009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:23.893339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef3811-7c44-47a3-bf37-5b1cba9d3075 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:23.915756 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:23.963714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:23.964602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:23.964891 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:23.965170 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] PATH_INFO: `/v3/users/6a5af25e4340491bb3535c2f38226212` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:23.967098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5af25e4340491bb3535c2f38226212)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:23.969294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:24.029208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5af25e4340491bb3535c2f38226212'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.031080 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5af25e4340491bb3535c2f38226212'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.040172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5af25e4340491bb3535c2f38226212'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.041009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5af25e4340491bb3535c2f38226212'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.051246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5af25e4340491bb3535c2f38226212'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.072850 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1357/2678] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:34:23 2022] DELETE /identity/v3/users/6a5af25e4340491bb3535c2f38226212 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:24.296461 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:24.298951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:24.319281 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057e526-a2e0-4eb6-a0df-cce9b5ed8891 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:24.395712 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:24.396932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:24.397059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:24.397339 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] PATH_INFO: `/v3/projects/8a53007ee0b84a2f921f0543bdd78b41` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:24.400372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a53007ee0b84a2f921f0543bdd78b41)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:24.402339 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:24.462286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:24.464830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a53007ee0b84a2f921f0543bdd78b41', 'request_id': 'req-8860014d-05ff-4c0e-870d-c6a0e93bd467'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.473376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a53007ee0b84a2f921f0543bdd78b41', 'request_id': 'req-8860014d-05ff-4c0e-870d-c6a0e93bd467'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.483078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a53007ee0b84a2f921f0543bdd78b41', 'request_id': 'req-8860014d-05ff-4c0e-870d-c6a0e93bd467'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.494578 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] The token cache is being invalidate because project 8a53007ee0b84a2f921f0543bdd78b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:34:24.494996 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.495781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8860014d-05ff-4c0e-870d-c6a0e93bd467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.498335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1322/2679] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:34:24 2022] DELETE /identity/v3/projects/8a53007ee0b84a2f921f0543bdd78b41 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:24.694173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:24.695902 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:24.714698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9900863-6bdf-4d8d-a85c-f46771a7e658 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:24.800875 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:24.801918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:24.802079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:24.802239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] PATH_INFO: `/v3/users/db13b893c01f46ca93a6ff0da99231c5` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:24.803533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db13b893c01f46ca93a6ff0da99231c5)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:24.805603 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:24.864159 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:24.874371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db13b893c01f46ca93a6ff0da99231c5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.875469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db13b893c01f46ca93a6ff0da99231c5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.883437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db13b893c01f46ca93a6ff0da99231c5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.884251 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db13b893c01f46ca93a6ff0da99231c5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.892270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db13b893c01f46ca93a6ff0da99231c5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:24.910896 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1358/2680] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:34:24 2022] DELETE /identity/v3/users/db13b893c01f46ca93a6ff0da99231c5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:24.915833 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fecee-7f53-48ba-b374-0c8064d1f74c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:24.916320 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fecee-7f53-48ba-b374-0c8064d1f74c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:24.916564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fecee-7f53-48ba-b374-0c8064d1f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:24.937891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8f1fecee-7f53-48ba-b374-0c8064d1f74c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:24.939198 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8f1fecee-7f53-48ba-b374-0c8064d1f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:25.008876 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1323/2681] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:25.018958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:25.020412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:25.078245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abaea9-2571-41b8-93da-2dc9700355a7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:25.081790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10683c8-7da4-46c6-bd85-ec4c0746ff03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:25.082429 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10683c8-7da4-46c6-bd85-ec4c0746ff03 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.082714 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10683c8-7da4-46c6-bd85-ec4c0746ff03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.082990 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10683c8-7da4-46c6-bd85-ec4c0746ff03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.092446 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10683c8-7da4-46c6-bd85-ec4c0746ff03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:25.093883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10683c8-7da4-46c6-bd85-ec4c0746ff03 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:25.103679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1359/2682] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:25.376147 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fecee-7f53-48ba-b374-0c8064d1f74c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:25.377719 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8f1fecee-7f53-48ba-b374-0c8064d1f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:25.390736 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fecee-7f53-48ba-b374-0c8064d1f74c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:25.395483 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:25.396379 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.396661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.396941 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] PATH_INFO: `/v3/projects/bec77cc8ef7b4b0ab2c035915ae4709a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.398351 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec77cc8ef7b4b0ab2c035915ae4709a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:25.400574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:25.449004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec77cc8ef7b4b0ab2c035915ae4709a', 'request_id': 'req-7b48d832-ac7e-4b66-8e9c-d517d6406a70'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:25.455120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec77cc8ef7b4b0ab2c035915ae4709a', 'request_id': 'req-7b48d832-ac7e-4b66-8e9c-d517d6406a70'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:25.462887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec77cc8ef7b4b0ab2c035915ae4709a', 'request_id': 'req-7b48d832-ac7e-4b66-8e9c-d517d6406a70'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:25.473421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] The token cache is being invalidate because project bec77cc8ef7b4b0ab2c035915ae4709a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:34:25.473735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:25.474563 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7b48d832-ac7e-4b66-8e9c-d517d6406a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:34:25.476419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1324/2683] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:34:25 2022] DELETE /identity/v3/projects/bec77cc8ef7b4b0ab2c035915ae4709a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:34:25.481296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028c77d-d8db-4f70-832f-8e225a3315a5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.482118 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028c77d-d8db-4f70-832f-8e225a3315a5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.482402 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028c77d-d8db-4f70-832f-8e225a3315a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.500628 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7028c77d-d8db-4f70-832f-8e225a3315a5 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:25.501832 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7028c77d-d8db-4f70-832f-8e225a3315a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:25.561176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1360/2684] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:25.569424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e028-969d-4547-8e2b-4929cec4e45b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.569748 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e028-969d-4547-8e2b-4929cec4e45b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.570090 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e028-969d-4547-8e2b-4929cec4e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.588333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-d278e028-969d-4547-8e2b-4929cec4e45b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:25.589622 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d278e028-969d-4547-8e2b-4929cec4e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:25.598165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1325/2685] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:25.602683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028c77d-d8db-4f70-832f-8e225a3315a5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:25.612935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028c77d-d8db-4f70-832f-8e225a3315a5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:25.617547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e75fd-8838-42f3-bfba-4746f6327112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:25.618274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e75fd-8838-42f3-bfba-4746f6327112 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.618468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e75fd-8838-42f3-bfba-4746f6327112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.618744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e75fd-8838-42f3-bfba-4746f6327112 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.619461 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e75fd-8838-42f3-bfba-4746f6327112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:34:25.619795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e75fd-8838-42f3-bfba-4746f6327112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:25.621390 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e75fd-8838-42f3-bfba-4746f6327112 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:25.633426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1361/2686] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:34:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:34:25.637816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e028-969d-4547-8e2b-4929cec4e45b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:25.647862 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e028-969d-4547-8e2b-4929cec4e45b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:25.652550 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec179858-05fc-44bf-84aa-20edb674aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:25.653202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec179858-05fc-44bf-84aa-20edb674aa7b admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.653490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec179858-05fc-44bf-84aa-20edb674aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.653770 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec179858-05fc-44bf-84aa-20edb674aa7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.654493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec179858-05fc-44bf-84aa-20edb674aa7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:25.656459 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec179858-05fc-44bf-84aa-20edb674aa7b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:25.681889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1326/2687] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:34:25 2022] POST /identity/v3/projects => generated 384 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:34:25.687169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e75fd-8838-42f3-bfba-4746f6327112 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:25.697248 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e75fd-8838-42f3-bfba-4746f6327112 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:25.743620 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:25.754369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c573900-d91b-4eff-960d-ffe531ff4014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:25.755032 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c573900-d91b-4eff-960d-ffe531ff4014 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.755320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c573900-d91b-4eff-960d-ffe531ff4014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.755635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c573900-d91b-4eff-960d-ffe531ff4014 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.756328 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c573900-d91b-4eff-960d-ffe531ff4014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:25.758258 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c573900-d91b-4eff-960d-ffe531ff4014 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:25.777567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1362/2688] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:34:25 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:34:25.782446 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec179858-05fc-44bf-84aa-20edb674aa7b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:25.792832 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec179858-05fc-44bf-84aa-20edb674aa7b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:25.798003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b3d2-5847-463c-a959-bf4a96e3aed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:25.798655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b3d2-5847-463c-a959-bf4a96e3aed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.798944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b3d2-5847-463c-a959-bf4a96e3aed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.799220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b3d2-5847-463c-a959-bf4a96e3aed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.799978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b3d2-5847-463c-a959-bf4a96e3aed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:25.801581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b3d2-5847-463c-a959-bf4a96e3aed6 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:25.811920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1327/2689] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:34:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:34:25.815901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c573900-d91b-4eff-960d-ffe531ff4014 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:25.826059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c573900-d91b-4eff-960d-ffe531ff4014 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:25.830890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cc916-46ea-43d0-809d-8153803a9e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:25.831656 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cc916-46ea-43d0-809d-8153803a9e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.831999 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cc916-46ea-43d0-809d-8153803a9e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.832277 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cc916-46ea-43d0-809d-8153803a9e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.833054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cc916-46ea-43d0-809d-8153803a9e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:25.834629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cc916-46ea-43d0-809d-8153803a9e02 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:25.845790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1363/2690] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:34:25 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:34:25.849979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b3d2-5847-463c-a959-bf4a96e3aed6 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:25.861243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b3d2-5847-463c-a959-bf4a96e3aed6 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:25.865967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd78536-12da-4509-bd8c-6f342973b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:25.866885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd78536-12da-4509-bd8c-6f342973b617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.867195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd78536-12da-4509-bd8c-6f342973b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.867475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd78536-12da-4509-bd8c-6f342973b617 admin admin] PATH_INFO: `/v3/projects/0a3209e7f8bd4b61b38e7791d9abc5cf/users/75626c545f2c4ca1986b3f0ee2e20fef/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.882978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd78536-12da-4509-bd8c-6f342973b617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3209e7f8bd4b61b38e7791d9abc5cf, user_id=75626c545f2c4ca1986b3f0ee2e20fef, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:25.885821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd78536-12da-4509-bd8c-6f342973b617 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:25.888913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:25.900300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1328/2691] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:34:25 2022] PUT /identity/v3/projects/0a3209e7f8bd4b61b38e7791d9abc5cf/users/75626c545f2c4ca1986b3f0ee2e20fef/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:34:25.905890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aeed9-a68a-49fa-a722-6bbb57570852 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:25.906183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aeed9-a68a-49fa-a722-6bbb57570852 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:25.906468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aeed9-a68a-49fa-a722-6bbb57570852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:25.924460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-624aeed9-a68a-49fa-a722-6bbb57570852 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:25.925685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-624aeed9-a68a-49fa-a722-6bbb57570852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:25.986418 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1364/2692] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:25.995934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd78536-12da-4509-bd8c-6f342973b617 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:25.997690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9bd78536-12da-4509-bd8c-6f342973b617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:26.056593 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd78536-12da-4509-bd8c-6f342973b617 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:26.060268 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076522ba-3758-40a9-9316-fa2c639d9140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:26.060915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076522ba-3758-40a9-9316-fa2c639d9140 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:26.061222 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076522ba-3758-40a9-9316-fa2c639d9140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:26.061498 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076522ba-3758-40a9-9316-fa2c639d9140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:26.070771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076522ba-3758-40a9-9316-fa2c639d9140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:26.072252 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076522ba-3758-40a9-9316-fa2c639d9140 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:26.082275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1329/2693] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:26.928481 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79300f9-ebc1-4292-b633-80b9d9cab40b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:26.929031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79300f9-ebc1-4292-b633-80b9d9cab40b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:26.929031 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79300f9-ebc1-4292-b633-80b9d9cab40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:26.956926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e79300f9-ebc1-4292-b633-80b9d9cab40b None None] MFA Rules not processed for user `75626c545f2c4ca1986b3f0ee2e20fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:26.958143 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e79300f9-ebc1-4292-b633-80b9d9cab40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:27.025994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1365/2694] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:34:27.036908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076522ba-3758-40a9-9316-fa2c639d9140 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:27.038424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-076522ba-3758-40a9-9316-fa2c639d9140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:27.101366 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076522ba-3758-40a9-9316-fa2c639d9140 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:27.105086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5a47a-8056-4d95-8396-285db5f33f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:27.105787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5a47a-8056-4d95-8396-285db5f33f52 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:27.106075 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5a47a-8056-4d95-8396-285db5f33f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:27.106857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5a47a-8056-4d95-8396-285db5f33f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:27.116733 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5a47a-8056-4d95-8396-285db5f33f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:27.118196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5a47a-8056-4d95-8396-285db5f33f52 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:27.129157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1330/2695] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:28.488180 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537966-6880-47dd-a3d0-494eab8f81aa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:28.488746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537966-6880-47dd-a3d0-494eab8f81aa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:28.488746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537966-6880-47dd-a3d0-494eab8f81aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:28.506534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0a537966-6880-47dd-a3d0-494eab8f81aa None None] MFA Rules not processed for user `75626c545f2c4ca1986b3f0ee2e20fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:28.507776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0a537966-6880-47dd-a3d0-494eab8f81aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:28.515239 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1366/2696] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:28.747406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5a47a-8056-4d95-8396-285db5f33f52 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:28.757349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5a47a-8056-4d95-8396-285db5f33f52 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:28.761015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:28.761651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:28.761936 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:28.762224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:28.764771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:28.775109 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:28.776579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:28.785298 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1331/2697] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:38.501223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:38.781328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=60 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:53.580065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67380-3e6f-4d58-bb60-8c19bfbde1da None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:53.580640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67380-3e6f-4d58-bb60-8c19bfbde1da None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:53.580640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67380-3e6f-4d58-bb60-8c19bfbde1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:53.599035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-74b67380-3e6f-4d58-bb60-8c19bfbde1da None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:53.600528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-74b67380-3e6f-4d58-bb60-8c19bfbde1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:53.608469 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1367/2698] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:53.625039 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:53.626564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:53.700181 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3598db5-4a7e-4a38-9fac-704fa6b9708d service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:53.706182 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ae74-2489-470e-9aa2-edeb65ca7c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:53.706827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ae74-2489-470e-9aa2-edeb65ca7c5c service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:53.707114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ae74-2489-470e-9aa2-edeb65ca7c5c service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:53.707400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395ae74-2489-470e-9aa2-edeb65ca7c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:53.715685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395ae74-2489-470e-9aa2-edeb65ca7c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:53.717279 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395ae74-2489-470e-9aa2-edeb65ca7c5c service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:53.727787 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1332/2699] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:34:56.632173 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf305-8e85-4c06-a074-18b6252e30f4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:56.632722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf305-8e85-4c06-a074-18b6252e30f4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:56.632868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cf305-8e85-4c06-a074-18b6252e30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:56.650751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cc4cf305-8e85-4c06-a074-18b6252e30f4 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:56.651986 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cc4cf305-8e85-4c06-a074-18b6252e30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:56.660303 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1368/2700] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:56.687092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ae74-2489-470e-9aa2-edeb65ca7c5c service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:56.689211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6395ae74-2489-470e-9aa2-edeb65ca7c5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:56.703717 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395ae74-2489-470e-9aa2-edeb65ca7c5c service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:56.709091 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f11e22-109d-46e4-8642-fbbf293384b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:56.709722 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f11e22-109d-46e4-8642-fbbf293384b4 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:56.710006 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f11e22-109d-46e4-8642-fbbf293384b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:56.710321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f11e22-109d-46e4-8642-fbbf293384b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:56.718636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f11e22-109d-46e4-8642-fbbf293384b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:56.720773 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f11e22-109d-46e4-8642-fbbf293384b4 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:56.730684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1333/2701] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:34:59.881580 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9946f58-0d6d-4ac1-bacc-49287edf65d8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:59.882160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9946f58-0d6d-4ac1-bacc-49287edf65d8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:59.882160 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9946f58-0d6d-4ac1-bacc-49287edf65d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:59.900353 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a9946f58-0d6d-4ac1-bacc-49287edf65d8 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:34:59.901542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a9946f58-0d6d-4ac1-bacc-49287edf65d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:34:59.909355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1369/2702] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:34:59.924802 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f11e22-109d-46e4-8642-fbbf293384b4 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:34:59.936248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f11e22-109d-46e4-8642-fbbf293384b4 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:34:59.942358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1fee4-c684-40f5-84ab-730a25fa25aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:34:59.943011 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1fee4-c684-40f5-84ab-730a25fa25aa service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:34:59.943293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1fee4-c684-40f5-84ab-730a25fa25aa service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:34:59.943596 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1fee4-c684-40f5-84ab-730a25fa25aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:34:59.951905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1fee4-c684-40f5-84ab-730a25fa25aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:34:59.953512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1fee4-c684-40f5-84ab-730a25fa25aa service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:34:59.964505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1334/2703] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:35:02.983150 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b73a-e89d-4df8-a8c4-bff0e2b544e0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:02.983683 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b73a-e89d-4df8-a8c4-bff0e2b544e0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:02.983796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b73a-e89d-4df8-a8c4-bff0e2b544e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:03.003506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-eae6b73a-e89d-4df8-a8c4-bff0e2b544e0 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:03.005063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eae6b73a-e89d-4df8-a8c4-bff0e2b544e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:03.014207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1370/2704] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:35:03.029894 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1fee4-c684-40f5-84ab-730a25fa25aa service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:35:03.041594 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1fee4-c684-40f5-84ab-730a25fa25aa service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:35:03.047771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79abb7-5142-4f0a-9e88-77e976b33d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:35:03.048480 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79abb7-5142-4f0a-9e88-77e976b33d70 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:03.048766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79abb7-5142-4f0a-9e88-77e976b33d70 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:03.049045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79abb7-5142-4f0a-9e88-77e976b33d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:03.058957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79abb7-5142-4f0a-9e88-77e976b33d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:35:03.060575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79abb7-5142-4f0a-9e88-77e976b33d70 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:35:03.071401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1335/2705] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:35:06.132308 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b172bfb-1028-4a10-bd4f-dee3bcc4643c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:06.132821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b172bfb-1028-4a10-bd4f-dee3bcc4643c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:06.132923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b172bfb-1028-4a10-bd4f-dee3bcc4643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:06.150965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8b172bfb-1028-4a10-bd4f-dee3bcc4643c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:06.152174 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8b172bfb-1028-4a10-bd4f-dee3bcc4643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:06.160326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1371/2706] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:35:06.176151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79abb7-5142-4f0a-9e88-77e976b33d70 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:35:06.189167 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79abb7-5142-4f0a-9e88-77e976b33d70 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:35:06.194746 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bff97-a025-4877-a06b-a884d9190918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:35:06.195372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bff97-a025-4877-a06b-a884d9190918 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:06.195702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bff97-a025-4877-a06b-a884d9190918 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:06.196022 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bff97-a025-4877-a06b-a884d9190918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:06.204851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bff97-a025-4877-a06b-a884d9190918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:35:06.206436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bff97-a025-4877-a06b-a884d9190918 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:35:06.216410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1336/2707] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:35:15.460711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c81ce-53f0-4646-8ede-48fff8d7ccba None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:15.461425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c81ce-53f0-4646-8ede-48fff8d7ccba None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:15.461425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c81ce-53f0-4646-8ede-48fff8d7ccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:15.485534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-694c81ce-53f0-4646-8ede-48fff8d7ccba None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:15.486780 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-694c81ce-53f0-4646-8ede-48fff8d7ccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:15.495681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1372/2708] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:35:15.511471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bff97-a025-4877-a06b-a884d9190918 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:35:15.523124 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bff97-a025-4877-a06b-a884d9190918 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:35:15.528974 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908c4db-8550-4f99-91ca-955643352c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:35:15.529623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908c4db-8550-4f99-91ca-955643352c89 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:15.529909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908c4db-8550-4f99-91ca-955643352c89 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:15.530179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908c4db-8550-4f99-91ca-955643352c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:15.539692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908c4db-8550-4f99-91ca-955643352c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:35:15.541263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908c4db-8550-4f99-91ca-955643352c89 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:35:15.554235 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1337/2709] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:35:17.882607 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4ac65-2605-4bfc-8dda-b5c71a71c802 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:17.883163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4ac65-2605-4bfc-8dda-b5c71a71c802 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:17.883163 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4ac65-2605-4bfc-8dda-b5c71a71c802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:17.901719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-57d4ac65-2605-4bfc-8dda-b5c71a71c802 None None] MFA Rules not processed for user `435fe25611c8486e81afae7e81e2aa65`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:17.902847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-57d4ac65-2605-4bfc-8dda-b5c71a71c802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:17.983899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1373/2710] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:35:25.547572 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=64 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:35:27.975090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=43 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:35:29.487765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07910d-24bb-4ee7-b220-a958e1d2e691 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:29.488278 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07910d-24bb-4ee7-b220-a958e1d2e691 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:29.488401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07910d-24bb-4ee7-b220-a958e1d2e691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:29.506383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-4e07910d-24bb-4ee7-b220-a958e1d2e691 None None] MFA Rules not processed for user `75626c545f2c4ca1986b3f0ee2e20fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:29.507623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-4e07910d-24bb-4ee7-b220-a958e1d2e691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:29.514463 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1338/2711] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:35:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:35:39.500957 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:35:40.263293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0be94-a9ed-49c3-8ddd-60b0fa6f5756 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:40.263938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0be94-a9ed-49c3-8ddd-60b0fa6f5756 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:40.264093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0be94-a9ed-49c3-8ddd-60b0fa6f5756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:40.284982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d8e0be94-a9ed-49c3-8ddd-60b0fa6f5756 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:40.286766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d8e0be94-a9ed-49c3-8ddd-60b0fa6f5756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:40.294723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1374/2712] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:35:40.310419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07910d-24bb-4ee7-b220-a958e1d2e691 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:35:40.323412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07910d-24bb-4ee7-b220-a958e1d2e691 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:35:40.329054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17663-efcf-4071-bf74-32ce378b345c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:35:40.329701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17663-efcf-4071-bf74-32ce378b345c service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:40.329979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17663-efcf-4071-bf74-32ce378b345c service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:40.330256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17663-efcf-4071-bf74-32ce378b345c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:40.339424 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b17663-efcf-4071-bf74-32ce378b345c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:35:40.341034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b17663-efcf-4071-bf74-32ce378b345c service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:35:40.351669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1339/2713] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:35:43.521018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340d4d0-b8e4-4944-8de3-5a1eef38fd1b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:43.521579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340d4d0-b8e4-4944-8de3-5a1eef38fd1b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:43.521673 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340d4d0-b8e4-4944-8de3-5a1eef38fd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:43.540600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2340d4d0-b8e4-4944-8de3-5a1eef38fd1b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:43.541802 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2340d4d0-b8e4-4944-8de3-5a1eef38fd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:43.549882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1375/2714] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:35:43.567707 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17663-efcf-4071-bf74-32ce378b345c service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:35:43.578968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17663-efcf-4071-bf74-32ce378b345c service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:35:43.584453 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768cc60-323a-4054-8968-063832fffa31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:35:43.585082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768cc60-323a-4054-8968-063832fffa31 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:43.585365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768cc60-323a-4054-8968-063832fffa31 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:43.585641 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768cc60-323a-4054-8968-063832fffa31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:43.593920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768cc60-323a-4054-8968-063832fffa31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:35:43.595495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768cc60-323a-4054-8968-063832fffa31 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:35:43.605949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1340/2715] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:35:46.634786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0c29-ef3b-4c31-905a-f0ed760c180a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:46.635332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0c29-ef3b-4c31-905a-f0ed760c180a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:46.635332 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0c29-ef3b-4c31-905a-f0ed760c180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:46.654272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0ede0c29-ef3b-4c31-905a-f0ed760c180a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:46.655467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0ede0c29-ef3b-4c31-905a-f0ed760c180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:46.663336 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1376/2716] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:35:46.677987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768cc60-323a-4054-8968-063832fffa31 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:35:46.689494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768cc60-323a-4054-8968-063832fffa31 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:35:46.695678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909c933-98ca-4214-aa7a-f5cbbfd8ca39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:35:46.696314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909c933-98ca-4214-aa7a-f5cbbfd8ca39 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:46.696600 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909c933-98ca-4214-aa7a-f5cbbfd8ca39 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:46.696910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909c933-98ca-4214-aa7a-f5cbbfd8ca39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:46.705419 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909c933-98ca-4214-aa7a-f5cbbfd8ca39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:35:46.707005 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909c933-98ca-4214-aa7a-f5cbbfd8ca39 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:35:46.717337 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1341/2717] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:35:49.782322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c79e1-8722-40ad-814b-64a658d12f8b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:49.782818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c79e1-8722-40ad-814b-64a658d12f8b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:49.782926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c79e1-8722-40ad-814b-64a658d12f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:49.800343 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-905c79e1-8722-40ad-814b-64a658d12f8b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:49.801521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-905c79e1-8722-40ad-814b-64a658d12f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:49.809854 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1377/2718] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:35:49.825659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909c933-98ca-4214-aa7a-f5cbbfd8ca39 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:35:49.837317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909c933-98ca-4214-aa7a-f5cbbfd8ca39 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:35:49.843273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d394-5559-4939-baf8-ed394d28cd28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:35:49.843944 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d394-5559-4939-baf8-ed394d28cd28 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:49.844224 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d394-5559-4939-baf8-ed394d28cd28 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:49.844501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d394-5559-4939-baf8-ed394d28cd28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:49.853236 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735d394-5559-4939-baf8-ed394d28cd28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:35:49.854839 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735d394-5559-4939-baf8-ed394d28cd28 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:35:49.865968 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1342/2719] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:35:52.964695 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce58c8-63fd-4e0d-8a38-c4add3521bff None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:52.965267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce58c8-63fd-4e0d-8a38-c4add3521bff None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:52.965267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce58c8-63fd-4e0d-8a38-c4add3521bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:52.984085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a2ce58c8-63fd-4e0d-8a38-c4add3521bff None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:35:52.985288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a2ce58c8-63fd-4e0d-8a38-c4add3521bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:35:52.993394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1378/2720] 10.222.0.97 () {58 vars in 1020 bytes} [Fri Jun 3 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:35:53.011040 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d394-5559-4939-baf8-ed394d28cd28 service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:35:53.025814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735d394-5559-4939-baf8-ed394d28cd28 service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:35:53.031271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920d53-863b-44a1-b164-23bef6078d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:35:53.032211 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920d53-863b-44a1-b164-23bef6078d2b service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:35:53.032495 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920d53-863b-44a1-b164-23bef6078d2b service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:35:53.032772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920d53-863b-44a1-b164-23bef6078d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:35:53.041556 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79920d53-863b-44a1-b164-23bef6078d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:35:53.043082 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79920d53-863b-44a1-b164-23bef6078d2b service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:35:53.053270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1343/2721] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:36:02.569882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce58c8-63fd-4e0d-8a38-c4add3521bff None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:02.571323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a2ce58c8-63fd-4e0d-8a38-c4add3521bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:02.648934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce58c8-63fd-4e0d-8a38-c4add3521bff None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:02.654319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265a8e9-2950-4964-87e1-9585f4339a01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:02.654968 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265a8e9-2950-4964-87e1-9585f4339a01 service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:02.655254 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265a8e9-2950-4964-87e1-9585f4339a01 service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:02.655535 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265a8e9-2950-4964-87e1-9585f4339a01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:02.657416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2265a8e9-2950-4964-87e1-9585f4339a01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:02.670189 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265a8e9-2950-4964-87e1-9585f4339a01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:02.671827 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265a8e9-2950-4964-87e1-9585f4339a01 service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:02.682555 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1379/2722] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:36:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:36:03.048469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=30 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:12.677860 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=47 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:21.469701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920d53-863b-44a1-b164-23bef6078d2b service nova] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:21.482363 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920d53-863b-44a1-b164-23bef6078d2b service nova] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:21.488647 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f11d1-b6e2-4278-9e6c-088e4bf7e91c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:21.489421 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f11d1-b6e2-4278-9e6c-088e4bf7e91c service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:21.489901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f11d1-b6e2-4278-9e6c-088e4bf7e91c service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:21.490352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f11d1-b6e2-4278-9e6c-088e4bf7e91c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:21.492491 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b86f11d1-b6e2-4278-9e6c-088e4bf7e91c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:21.505986 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f11d1-b6e2-4278-9e6c-088e4bf7e91c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:21.508172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f11d1-b6e2-4278-9e6c-088e4bf7e91c service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:21.520762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1344/2723] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:36:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:36:21.544071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265a8e9-2950-4964-87e1-9585f4339a01 service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:21.565171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265a8e9-2950-4964-87e1-9585f4339a01 service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:21.572812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:21.573702 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:21.573982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:21.574257 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] PATH_INFO: `/v3/users/75626c545f2c4ca1986b3f0ee2e20fef` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:21.575463 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75626c545f2c4ca1986b3f0ee2e20fef)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:21.577479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:21.640869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75626c545f2c4ca1986b3f0ee2e20fef'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:21.641958 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75626c545f2c4ca1986b3f0ee2e20fef'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:21.657996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75626c545f2c4ca1986b3f0ee2e20fef'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:21.658776 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75626c545f2c4ca1986b3f0ee2e20fef'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:21.668712 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9fee07b0-99aa-4e24-a5bb-181ccbbbe627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75626c545f2c4ca1986b3f0ee2e20fef'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:21.690981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1380/2724] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:36:21 2022] DELETE /identity/v3/users/75626c545f2c4ca1986b3f0ee2e20fef => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:36:21.920494 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f11d1-b6e2-4278-9e6c-088e4bf7e91c service placement] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:21.944045 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f11d1-b6e2-4278-9e6c-088e4bf7e91c service placement] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:22.025425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:22.026381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.026667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.026950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] PATH_INFO: `/v3/projects/0a3209e7f8bd4b61b38e7791d9abc5cf` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.028239 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3209e7f8bd4b61b38e7791d9abc5cf)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:22.030173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:22.093249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3209e7f8bd4b61b38e7791d9abc5cf', 'request_id': 'req-9bfc664c-a46b-4822-856a-de2822ec5a7c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:22.101102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3209e7f8bd4b61b38e7791d9abc5cf', 'request_id': 'req-9bfc664c-a46b-4822-856a-de2822ec5a7c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:22.109595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3209e7f8bd4b61b38e7791d9abc5cf', 'request_id': 'req-9bfc664c-a46b-4822-856a-de2822ec5a7c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:22.123467 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] The token cache is being invalidate because project 0a3209e7f8bd4b61b38e7791d9abc5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:36:22.123810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:22.124492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-9bfc664c-a46b-4822-856a-de2822ec5a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:22.126090 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1345/2725] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:36:21 2022] DELETE /identity/v3/projects/0a3209e7f8bd4b61b38e7791d9abc5cf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:36:22.133082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa80ccf-43cf-4814-8035-c676696e0835 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.133381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa80ccf-43cf-4814-8035-c676696e0835 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.133978 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa80ccf-43cf-4814-8035-c676696e0835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.159399 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4aa80ccf-43cf-4814-8035-c676696e0835 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:22.161350 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4aa80ccf-43cf-4814-8035-c676696e0835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:22.225405 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1381/2726] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:22.234111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86473b-ff99-4f6c-88fe-81c0350e35fd None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.234408 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86473b-ff99-4f6c-88fe-81c0350e35fd None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.234696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86473b-ff99-4f6c-88fe-81c0350e35fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.254489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-8c86473b-ff99-4f6c-88fe-81c0350e35fd None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:22.255777 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8c86473b-ff99-4f6c-88fe-81c0350e35fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:22.263938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1346/2727] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:36:22.268174 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa80ccf-43cf-4814-8035-c676696e0835 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:22.285025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa80ccf-43cf-4814-8035-c676696e0835 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:22.290354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2a119-bf72-4dcc-ac81-15fb71fe6f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:22.291021 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2a119-bf72-4dcc-ac81-15fb71fe6f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.291311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2a119-bf72-4dcc-ac81-15fb71fe6f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.291624 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2a119-bf72-4dcc-ac81-15fb71fe6f6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.292372 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2a119-bf72-4dcc-ac81-15fb71fe6f6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:36:22.292690 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2a119-bf72-4dcc-ac81-15fb71fe6f6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:22.294311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2a119-bf72-4dcc-ac81-15fb71fe6f6c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:22.307272 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1382/2728] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:36:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:36:22.311838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86473b-ff99-4f6c-88fe-81c0350e35fd None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:22.322285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86473b-ff99-4f6c-88fe-81c0350e35fd None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:22.327305 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1141d-d2f8-4a51-a171-d7c5d0b9520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:22.327999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1141d-d2f8-4a51-a171-d7c5d0b9520e admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.328773 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1141d-d2f8-4a51-a171-d7c5d0b9520e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.328773 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1141d-d2f8-4a51-a171-d7c5d0b9520e admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.329241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1141d-d2f8-4a51-a171-d7c5d0b9520e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:22.331197 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1141d-d2f8-4a51-a171-d7c5d0b9520e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:22.362913 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1347/2729] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:36:22 2022] POST /identity/v3/projects => generated 382 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:36:22.367664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2a119-bf72-4dcc-ac81-15fb71fe6f6c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:22.377987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2a119-bf72-4dcc-ac81-15fb71fe6f6c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:22.441657 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc5022-1aca-45f5-8019-a4c15bf105da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:22.442349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc5022-1aca-45f5-8019-a4c15bf105da admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.442637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc5022-1aca-45f5-8019-a4c15bf105da admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.442925 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc5022-1aca-45f5-8019-a4c15bf105da admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.443698 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc5022-1aca-45f5-8019-a4c15bf105da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:22.445687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc5022-1aca-45f5-8019-a4c15bf105da admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:22.452967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:22.470480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1383/2730] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:36:22 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:36:22.474678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1141d-d2f8-4a51-a171-d7c5d0b9520e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:22.488752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1141d-d2f8-4a51-a171-d7c5d0b9520e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:22.494113 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f0aa-c64e-4dda-bb5b-0bb528da2901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:22.494791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f0aa-c64e-4dda-bb5b-0bb528da2901 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.495071 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f0aa-c64e-4dda-bb5b-0bb528da2901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.495343 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f0aa-c64e-4dda-bb5b-0bb528da2901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.496128 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f0aa-c64e-4dda-bb5b-0bb528da2901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:22.497756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f0aa-c64e-4dda-bb5b-0bb528da2901 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:22.509441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1348/2731] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:36:22 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:36:22.514229 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc5022-1aca-45f5-8019-a4c15bf105da admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:22.526166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc5022-1aca-45f5-8019-a4c15bf105da admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:22.530835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925a1c0-e279-4b30-990e-712d9b15a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:22.531506 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925a1c0-e279-4b30-990e-712d9b15a616 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.531818 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925a1c0-e279-4b30-990e-712d9b15a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.532096 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925a1c0-e279-4b30-990e-712d9b15a616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.532829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925a1c0-e279-4b30-990e-712d9b15a616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:22.534437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925a1c0-e279-4b30-990e-712d9b15a616 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:22.546331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1384/2732] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:36:22 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:36:22.550919 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f0aa-c64e-4dda-bb5b-0bb528da2901 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:22.562013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f0aa-c64e-4dda-bb5b-0bb528da2901 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:22.567012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026e19-846e-4a2f-9935-8e24283aa2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:22.567952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026e19-846e-4a2f-9935-8e24283aa2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.568231 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026e19-846e-4a2f-9935-8e24283aa2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.568512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026e19-846e-4a2f-9935-8e24283aa2ef admin admin] PATH_INFO: `/v3/projects/8437ba25a58f47bb9eec771562a14c4f/users/6284a65a298b4cb48dec2fcd020d5e4e/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.586642 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026e19-846e-4a2f-9935-8e24283aa2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8437ba25a58f47bb9eec771562a14c4f, user_id=6284a65a298b4cb48dec2fcd020d5e4e, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:22.589370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026e19-846e-4a2f-9935-8e24283aa2ef admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:22.605036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1349/2733] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:36:22 2022] PUT /identity/v3/projects/8437ba25a58f47bb9eec771562a14c4f/users/6284a65a298b4cb48dec2fcd020d5e4e/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:36:22.610300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564ffd2-e5c1-4c48-a286-63a7095d3ac1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.610612 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564ffd2-e5c1-4c48-a286-63a7095d3ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.610892 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564ffd2-e5c1-4c48-a286-63a7095d3ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.630330 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6564ffd2-e5c1-4c48-a286-63a7095d3ac1 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:22.631611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6564ffd2-e5c1-4c48-a286-63a7095d3ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:22.696881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1385/2734] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:36:22.706820 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026e19-846e-4a2f-9935-8e24283aa2ef admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:22.708857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-e0026e19-846e-4a2f-9935-8e24283aa2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:22.724650 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:22.782133 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026e19-846e-4a2f-9935-8e24283aa2ef admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:22.785933 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9be70-d71d-456f-9c31-7d52e33a41ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:22.786595 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9be70-d71d-456f-9c31-7d52e33a41ec service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:22.786883 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9be70-d71d-456f-9c31-7d52e33a41ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:22.787163 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9be70-d71d-456f-9c31-7d52e33a41ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:22.797907 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9be70-d71d-456f-9c31-7d52e33a41ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:22.799393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9be70-d71d-456f-9c31-7d52e33a41ec service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:22.810004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1350/2735] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:36:27.169291 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564ffd2-e5c1-4c48-a286-63a7095d3ac1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:27.170851 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6564ffd2-e5c1-4c48-a286-63a7095d3ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:27.183752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564ffd2-e5c1-4c48-a286-63a7095d3ac1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:27.196815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:27.198179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:27.198650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:27.199233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] PATH_INFO: `/v3/users/435fe25611c8486e81afae7e81e2aa65` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:27.200722 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435fe25611c8486e81afae7e81e2aa65)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:27.203505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:27.310625 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435fe25611c8486e81afae7e81e2aa65'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.314326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435fe25611c8486e81afae7e81e2aa65'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.325696 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435fe25611c8486e81afae7e81e2aa65'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.326918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435fe25611c8486e81afae7e81e2aa65'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.344208 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5c21bb35-4429-4726-9e70-2edc22aa3f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435fe25611c8486e81afae7e81e2aa65'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.379650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1386/2736] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:36:27 2022] DELETE /identity/v3/users/435fe25611c8486e81afae7e81e2aa65 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:36:27.576158 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9be70-d71d-456f-9c31-7d52e33a41ec service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:27.589972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9be70-d71d-456f-9c31-7d52e33a41ec service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:27.698921 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:27.701021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:27.701946 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:27.702612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] PATH_INFO: `/v3/projects/21b3185b2cd34f10ba0fad0748352809` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:27.704890 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b3185b2cd34f10ba0fad0748352809)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:27.710127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:27.823127 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b3185b2cd34f10ba0fad0748352809', 'request_id': 'req-d1f66ef6-5621-4e52-82d5-ce218aa5596f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.830851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b3185b2cd34f10ba0fad0748352809', 'request_id': 'req-d1f66ef6-5621-4e52-82d5-ce218aa5596f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.841674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b3185b2cd34f10ba0fad0748352809', 'request_id': 'req-d1f66ef6-5621-4e52-82d5-ce218aa5596f'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.867905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] The token cache is being invalidate because project 21b3185b2cd34f10ba0fad0748352809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:36:27.868436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.871567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-d1f66ef6-5621-4e52-82d5-ce218aa5596f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:36:27.874284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1351/2737] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:36:27 2022] DELETE /identity/v3/projects/21b3185b2cd34f10ba0fad0748352809 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:36:27.883138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217db16-c12e-4fcf-b585-bf44a80b27e9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:27.883738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217db16-c12e-4fcf-b585-bf44a80b27e9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:27.884205 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217db16-c12e-4fcf-b585-bf44a80b27e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:27.912278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7217db16-c12e-4fcf-b585-bf44a80b27e9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:27.914315 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7217db16-c12e-4fcf-b585-bf44a80b27e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:27.998742 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:28.025611 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1387/2738] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:28.035472 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517762b-cede-4d0e-8838-712cf33d940b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.035791 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517762b-cede-4d0e-8838-712cf33d940b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.036077 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517762b-cede-4d0e-8838-712cf33d940b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.060542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f517762b-cede-4d0e-8838-712cf33d940b None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:28.061879 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f517762b-cede-4d0e-8838-712cf33d940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:28.070624 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1352/2739] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:28.076419 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217db16-c12e-4fcf-b585-bf44a80b27e9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.109394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217db16-c12e-4fcf-b585-bf44a80b27e9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.153430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb7623-d301-4784-985c-f2472d77aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.154147 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb7623-d301-4784-985c-f2472d77aa2b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.154547 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb7623-d301-4784-985c-f2472d77aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.155020 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb7623-d301-4784-985c-f2472d77aa2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.156042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb7623-d301-4784-985c-f2472d77aa2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:36:28.156411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb7623-d301-4784-985c-f2472d77aa2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.158646 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb7623-d301-4784-985c-f2472d77aa2b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.174492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1388/2740] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:36:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:36:28.178703 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517762b-cede-4d0e-8838-712cf33d940b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.200243 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517762b-cede-4d0e-8838-712cf33d940b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.206140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1d66f-621b-4a6a-9697-bcbf91ba9be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.206850 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1d66f-621b-4a6a-9697-bcbf91ba9be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.207136 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1d66f-621b-4a6a-9697-bcbf91ba9be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.207415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1d66f-621b-4a6a-9697-bcbf91ba9be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.208225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1d66f-621b-4a6a-9697-bcbf91ba9be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.211064 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1d66f-621b-4a6a-9697-bcbf91ba9be9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.246165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1353/2741] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:36:28 2022] POST /identity/v3/projects => generated 374 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:36:28.250984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb7623-d301-4784-985c-f2472d77aa2b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.264978 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1f3ad-dd73-4e1f-8b7f-507bbf2fab08 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.265276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1f3ad-dd73-4e1f-8b7f-507bbf2fab08 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.265526 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1f3ad-dd73-4e1f-8b7f-507bbf2fab08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.270694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb7623-d301-4784-985c-f2472d77aa2b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.297098 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-02c1f3ad-dd73-4e1f-8b7f-507bbf2fab08 None None] MFA Rules not processed for user `6284a65a298b4cb48dec2fcd020d5e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:28.298838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-02c1f3ad-dd73-4e1f-8b7f-507bbf2fab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:28.304240 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:28.352859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb612d-089a-48fa-a6be-b007e57ec4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.353947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb612d-089a-48fa-a6be-b007e57ec4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.358679 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb612d-089a-48fa-a6be-b007e57ec4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.358970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb612d-089a-48fa-a6be-b007e57ec4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.359963 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb612d-089a-48fa-a6be-b007e57ec4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.362217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb612d-089a-48fa-a6be-b007e57ec4a7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.380037 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1354/2742] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:28.385250 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1f3ad-dd73-4e1f-8b7f-507bbf2fab08 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.385542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1389/2743] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:36:28 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:36:28.387132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-02c1f3ad-dd73-4e1f-8b7f-507bbf2fab08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:28.389856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb612d-089a-48fa-a6be-b007e57ec4a7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.401800 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb612d-089a-48fa-a6be-b007e57ec4a7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.404394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1f3ad-dd73-4e1f-8b7f-507bbf2fab08 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.406504 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99088489-75d4-4311-ae96-3066d35a73c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.407325 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99088489-75d4-4311-ae96-3066d35a73c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.407652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99088489-75d4-4311-ae96-3066d35a73c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.408130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99088489-75d4-4311-ae96-3066d35a73c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.409034 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99088489-75d4-4311-ae96-3066d35a73c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.409336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a5d5e-99c1-4414-b34b-7f9badd2c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.410016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a5d5e-99c1-4414-b34b-7f9badd2c076 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.410295 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a5d5e-99c1-4414-b34b-7f9badd2c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.410574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a5d5e-99c1-4414-b34b-7f9badd2c076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.411030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99088489-75d4-4311-ae96-3066d35a73c0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.411277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a5d5e-99c1-4414-b34b-7f9badd2c076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.413291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a5d5e-99c1-4414-b34b-7f9badd2c076 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.425499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1390/2744] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:36:28 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:36:28.427209 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99088489-75d4-4311-ae96-3066d35a73c0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.440951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99088489-75d4-4311-ae96-3066d35a73c0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.446898 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bb07e-a941-486f-b1c1-a42f81450a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.447662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bb07e-a941-486f-b1c1-a42f81450a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.447904 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bb07e-a941-486f-b1c1-a42f81450a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.448175 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bb07e-a941-486f-b1c1-a42f81450a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.448909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bb07e-a941-486f-b1c1-a42f81450a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.450533 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bb07e-a941-486f-b1c1-a42f81450a66 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.453945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1355/2745] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:36:28 2022] POST /identity/v3/projects => generated 384 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:36:28.455828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a5d5e-99c1-4414-b34b-7f9badd2c076 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.463275 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1391/2746] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:36:28 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:36:28.467342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bb07e-a941-486f-b1c1-a42f81450a66 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.479543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bb07e-a941-486f-b1c1-a42f81450a66 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.540646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a5d5e-99c1-4414-b34b-7f9badd2c076 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.545810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2c4e-5dfd-4bc1-a943-e75aebac1a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.546496 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2c4e-5dfd-4bc1-a943-e75aebac1a04 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.546776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2c4e-5dfd-4bc1-a943-e75aebac1a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.547048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e2c4e-5dfd-4bc1-a943-e75aebac1a04 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.547845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2c4e-5dfd-4bc1-a943-e75aebac1a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.549984 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e2c4e-5dfd-4bc1-a943-e75aebac1a04 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.552807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66877e85-ed66-46aa-a87e-303cc543991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.554297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66877e85-ed66-46aa-a87e-303cc543991c admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.554593 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66877e85-ed66-46aa-a87e-303cc543991c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.554872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66877e85-ed66-46aa-a87e-303cc543991c admin admin] PATH_INFO: `/v3/projects/33f1b15bac9e421dbd85121c57a204b3/users/4882d1d39c47445aa4541a3c802797f6/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.576935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66877e85-ed66-46aa-a87e-303cc543991c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f1b15bac9e421dbd85121c57a204b3, user_id=4882d1d39c47445aa4541a3c802797f6, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.577178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1356/2747] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:36:28 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:36:28.577629 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66877e85-ed66-46aa-a87e-303cc543991c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.578385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2c4e-5dfd-4bc1-a943-e75aebac1a04 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.590356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e2c4e-5dfd-4bc1-a943-e75aebac1a04 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.602466 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1392/2748] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:36:28 2022] PUT /identity/v3/projects/33f1b15bac9e421dbd85121c57a204b3/users/4882d1d39c47445aa4541a3c802797f6/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:36:28.604139 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae2c8-a9cb-4b14-ac0d-c3f353b278b1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.604436 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae2c8-a9cb-4b14-ac0d-c3f353b278b1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.604701 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae2c8-a9cb-4b14-ac0d-c3f353b278b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.634874 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-63cae2c8-a9cb-4b14-ac0d-c3f353b278b1 None None] MFA Rules not processed for user `4882d1d39c47445aa4541a3c802797f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:28.636339 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-63cae2c8-a9cb-4b14-ac0d-c3f353b278b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:28.656627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:28.686121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3edc09-d596-4e7d-bb96-39b9d53c3475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.686121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3edc09-d596-4e7d-bb96-39b9d53c3475 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.686121 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3edc09-d596-4e7d-bb96-39b9d53c3475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.686511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3edc09-d596-4e7d-bb96-39b9d53c3475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.687096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3edc09-d596-4e7d-bb96-39b9d53c3475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.688805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3edc09-d596-4e7d-bb96-39b9d53c3475 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.704052 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1357/2749] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:36:28 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:36:28.708271 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3edc09-d596-4e7d-bb96-39b9d53c3475 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.718031 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3edc09-d596-4e7d-bb96-39b9d53c3475 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.722789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25190ff4-d480-4164-92ef-c16e8b0f5e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.723721 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25190ff4-d480-4164-92ef-c16e8b0f5e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.724002 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25190ff4-d480-4164-92ef-c16e8b0f5e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.724273 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25190ff4-d480-4164-92ef-c16e8b0f5e3e admin admin] PATH_INFO: `/v3/projects/dac173517701457799b86a70fd8ce406/users/0d502e6dc27244798ea570c552cd400a/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.739414 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:28.747989 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25190ff4-d480-4164-92ef-c16e8b0f5e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac173517701457799b86a70fd8ce406, user_id=0d502e6dc27244798ea570c552cd400a, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.748427 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1393/2750] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:28.751119 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25190ff4-d480-4164-92ef-c16e8b0f5e3e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.752994 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae2c8-a9cb-4b14-ac0d-c3f353b278b1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.766133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae2c8-a9cb-4b14-ac0d-c3f353b278b1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.767290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1358/2751] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:36:28 2022] PUT /identity/v3/projects/dac173517701457799b86a70fd8ce406/users/0d502e6dc27244798ea570c552cd400a/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:36:28.771926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25190ff4-d480-4164-92ef-c16e8b0f5e3e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.837546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8988ad-78e0-44b4-ad30-84322bdf47c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.838340 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8988ad-78e0-44b4-ad30-84322bdf47c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.838559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8988ad-78e0-44b4-ad30-84322bdf47c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.839044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8988ad-78e0-44b4-ad30-84322bdf47c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.840289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8988ad-78e0-44b4-ad30-84322bdf47c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.842687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8988ad-78e0-44b4-ad30-84322bdf47c5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.848645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25190ff4-d480-4164-92ef-c16e8b0f5e3e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.855257 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722408d-7f30-403d-b917-2add5835faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.855938 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722408d-7f30-403d-b917-2add5835faa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.856270 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722408d-7f30-403d-b917-2add5835faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.856558 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722408d-7f30-403d-b917-2add5835faa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.857303 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722408d-7f30-403d-b917-2add5835faa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.859666 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722408d-7f30-403d-b917-2add5835faa0 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.872534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1359/2752] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:36:28 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:36:28.878754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722408d-7f30-403d-b917-2add5835faa0 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.885688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1394/2753] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:36:28 2022] POST /identity/v3/projects => generated 372 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:36:28.890356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8988ad-78e0-44b4-ad30-84322bdf47c5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:28.893286 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722408d-7f30-403d-b917-2add5835faa0 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.979534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8988ad-78e0-44b4-ad30-84322bdf47c5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:28.984290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6c703-8697-401b-87b9-8ed749e371c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.985115 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301d2d-2137-45c8-a938-448a6710d2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:28.985319 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c703-8697-401b-87b9-8ed749e371c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.985564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c703-8697-401b-87b9-8ed749e371c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.985732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301d2d-2137-45c8-a938-448a6710d2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:28.985854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c703-8697-401b-87b9-8ed749e371c5 admin admin] PATH_INFO: `/v3/projects/dac173517701457799b86a70fd8ce406/users/0d502e6dc27244798ea570c552cd400a/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.986018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301d2d-2137-45c8-a938-448a6710d2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:28.986290 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301d2d-2137-45c8-a938-448a6710d2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:28.987007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82301d2d-2137-45c8-a938-448a6710d2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.988285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6c703-8697-401b-87b9-8ed749e371c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac173517701457799b86a70fd8ce406, user_id=0d502e6dc27244798ea570c552cd400a, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:28.989288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82301d2d-2137-45c8-a938-448a6710d2a2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:28.991368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6c703-8697-401b-87b9-8ed749e371c5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:29.008599 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1360/2754] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:36:28 2022] PUT /identity/v3/projects/dac173517701457799b86a70fd8ce406/users/0d502e6dc27244798ea570c552cd400a/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:36:29.019719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1395/2755] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:36:28 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:36:29.022081 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6c703-8697-401b-87b9-8ed749e371c5 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:29.119906 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6c703-8697-401b-87b9-8ed749e371c5 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:29.126512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ef3e-a22e-442d-ad42-e6a227114c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:29.127988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ef3e-a22e-442d-ad42-e6a227114c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:29.128499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ef3e-a22e-442d-ad42-e6a227114c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:29.129225 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ef3e-a22e-442d-ad42-e6a227114c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:29.130185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ef3e-a22e-442d-ad42-e6a227114c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:29.133888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ef3e-a22e-442d-ad42-e6a227114c69 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:29.151740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1361/2756] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:36:29 2022] GET /identity/v3/roles => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 16:36:29.154245 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301d2d-2137-45c8-a938-448a6710d2a2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:29.168218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301d2d-2137-45c8-a938-448a6710d2a2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:29.180199 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25df6b-36f0-4d3b-84c0-76c08993068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:29.181331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25df6b-36f0-4d3b-84c0-76c08993068b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:29.182231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25df6b-36f0-4d3b-84c0-76c08993068b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:29.182957 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25df6b-36f0-4d3b-84c0-76c08993068b admin admin] PATH_INFO: `/v3/projects/517a603550214bbbbf3b0368f5d0e77f/users/663a026b145248efa3b640c0bae5ca91/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:29.205834 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25df6b-36f0-4d3b-84c0-76c08993068b admin admin] RBAC: Authorizing `identity:create_grant(project_id=517a603550214bbbbf3b0368f5d0e77f, user_id=663a026b145248efa3b640c0bae5ca91, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:29.209227 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25df6b-36f0-4d3b-84c0-76c08993068b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:29.232079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1396/2757] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:36:29 2022] PUT /identity/v3/projects/517a603550214bbbbf3b0368f5d0e77f/users/663a026b145248efa3b640c0bae5ca91/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:36:29.234399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ef3e-a22e-442d-ad42-e6a227114c69 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:29.247017 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ef3e-a22e-442d-ad42-e6a227114c69 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:29.259939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:29.355228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e37e-e717-4201-84a6-7693c9e3746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:29.355949 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e37e-e717-4201-84a6-7693c9e3746d admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:29.356522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e37e-e717-4201-84a6-7693c9e3746d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:29.356690 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e37e-e717-4201-84a6-7693c9e3746d admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:29.357821 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e37e-e717-4201-84a6-7693c9e3746d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:29.359730 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e37e-e717-4201-84a6-7693c9e3746d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:29.370713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1362/2758] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:36:29 2022] GET /identity/v3/roles => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:36:29.374936 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25df6b-36f0-4d3b-84c0-76c08993068b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:29.387296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25df6b-36f0-4d3b-84c0-76c08993068b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:29.393746 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8df07-c0b8-4772-a274-67a01666cd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:29.394829 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8df07-c0b8-4772-a274-67a01666cd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:29.395122 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8df07-c0b8-4772-a274-67a01666cd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:29.395393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8df07-c0b8-4772-a274-67a01666cd0a admin admin] PATH_INFO: `/v3/projects/517a603550214bbbbf3b0368f5d0e77f/users/663a026b145248efa3b640c0bae5ca91/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:29.398298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8df07-c0b8-4772-a274-67a01666cd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=517a603550214bbbbf3b0368f5d0e77f, user_id=663a026b145248efa3b640c0bae5ca91, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:29.402467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8df07-c0b8-4772-a274-67a01666cd0a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:29.410337 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:29.436042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1397/2759] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:36:29 2022] PUT /identity/v3/projects/517a603550214bbbbf3b0368f5d0e77f/users/663a026b145248efa3b640c0bae5ca91/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:36:29.447734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe257d4-19c8-4971-89c8-3a8e07f9287d None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:29.448134 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe257d4-19c8-4971-89c8-3a8e07f9287d None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:29.448490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe257d4-19c8-4971-89c8-3a8e07f9287d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:29.496129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-abe257d4-19c8-4971-89c8-3a8e07f9287d None None] MFA Rules not processed for user `663a026b145248efa3b640c0bae5ca91`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:29.497645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-abe257d4-19c8-4971-89c8-3a8e07f9287d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:29.584266 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1363/2760] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:29.598911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8df07-c0b8-4772-a274-67a01666cd0a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:29.602744 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a0e8df07-c0b8-4772-a274-67a01666cd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:29.667370 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8df07-c0b8-4772-a274-67a01666cd0a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:29.671206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d085add-fa50-44ff-bbfd-08f162b2f3df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:29.671890 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d085add-fa50-44ff-bbfd-08f162b2f3df service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:29.672194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d085add-fa50-44ff-bbfd-08f162b2f3df service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:29.672447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d085add-fa50-44ff-bbfd-08f162b2f3df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:29.683354 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d085add-fa50-44ff-bbfd-08f162b2f3df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:29.684921 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d085add-fa50-44ff-bbfd-08f162b2f3df service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:29.695803 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1398/2761] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:36:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:36:29.793411 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe257d4-19c8-4971-89c8-3a8e07f9287d None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:29.807444 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe257d4-19c8-4971-89c8-3a8e07f9287d None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:29.812129 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df81fc3-6529-4565-a86b-287036c8daf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:29.812845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df81fc3-6529-4565-a86b-287036c8daf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:29.813248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df81fc3-6529-4565-a86b-287036c8daf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:29.813534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df81fc3-6529-4565-a86b-287036c8daf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:29.886068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df81fc3-6529-4565-a86b-287036c8daf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:29.887481 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df81fc3-6529-4565-a86b-287036c8daf4 service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:29.897219 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1364/2762] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:36:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:36:33.713600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a044664-89d6-4a6e-ab5b-b96dea25ebc2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:33.714138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a044664-89d6-4a6e-ab5b-b96dea25ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:33.714138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a044664-89d6-4a6e-ab5b-b96dea25ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:33.742876 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3a044664-89d6-4a6e-ab5b-b96dea25ebc2 None None] MFA Rules not processed for user `0d502e6dc27244798ea570c552cd400a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:33.744213 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3a044664-89d6-4a6e-ab5b-b96dea25ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:33.824477 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1399/2763] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:33.837858 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df81fc3-6529-4565-a86b-287036c8daf4 service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:33.840701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-6df81fc3-6529-4565-a86b-287036c8daf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:33.878220 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:33.901581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df81fc3-6529-4565-a86b-287036c8daf4 service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:33.905441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106555-5cac-41ae-9f17-686e7b927a10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f440bbc0414415186ae83d9fa3842bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:33.906095 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106555-5cac-41ae-9f17-686e7b927a10 service glance] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:33.906380 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106555-5cac-41ae-9f17-686e7b927a10 service glance] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:33.906659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09106555-5cac-41ae-9f17-686e7b927a10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:33.966203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106555-5cac-41ae-9f17-686e7b927a10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:33.967776 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09106555-5cac-41ae-9f17-686e7b927a10 service glance] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:33.977735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1365/2764] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:36:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:36:34.092758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdbb4f-f5ad-4ec2-859b-515cdfb22b8a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:34.093044 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdbb4f-f5ad-4ec2-859b-515cdfb22b8a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:34.093323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdbb4f-f5ad-4ec2-859b-515cdfb22b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:34.116138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-99bdbb4f-f5ad-4ec2-859b-515cdfb22b8a None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:34.119918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-99bdbb4f-f5ad-4ec2-859b-515cdfb22b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:34.206643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1400/2765] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:36:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:34.266852 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106555-5cac-41ae-9f17-686e7b927a10 service glance] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:34.268349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-09106555-5cac-41ae-9f17-686e7b927a10 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:34.354541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09106555-5cac-41ae-9f17-686e7b927a10 service glance] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:34.367665 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90b146-4cc8-4bb3-a241-c25372c21e24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:34.368567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90b146-4cc8-4bb3-a241-c25372c21e24 service swift] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:34.369050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90b146-4cc8-4bb3-a241-c25372c21e24 service swift] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:34.369684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90b146-4cc8-4bb3-a241-c25372c21e24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:34.380450 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90b146-4cc8-4bb3-a241-c25372c21e24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:34.382328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90b146-4cc8-4bb3-a241-c25372c21e24 service swift] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:34.392331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1366/2766] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:36:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:36:44.083128 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ff34-a3b9-4268-bb4c-0c17bffc04d2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:44.084373 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ff34-a3b9-4268-bb4c-0c17bffc04d2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:44.084655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ff34-a3b9-4268-bb4c-0c17bffc04d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:44.111116 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c203ff34-a3b9-4268-bb4c-0c17bffc04d2 None None] MFA Rules not processed for user `6284a65a298b4cb48dec2fcd020d5e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:44.112444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c203ff34-a3b9-4268-bb4c-0c17bffc04d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:44.120302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1401/2767] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:44.388332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=65 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:46.821059 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703924eb-2487-46ce-96f2-80429a1aad87 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:46.821693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703924eb-2487-46ce-96f2-80429a1aad87 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:46.821693 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703924eb-2487-46ce-96f2-80429a1aad87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:46.839293 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-703924eb-2487-46ce-96f2-80429a1aad87 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:36:46.840576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-703924eb-2487-46ce-96f2-80429a1aad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:36:46.848021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1367/2768] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:36:46.859886 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ff34-a3b9-4268-bb4c-0c17bffc04d2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:36:46.872723 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ff34-a3b9-4268-bb4c-0c17bffc04d2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:36:46.878006 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d8985-c227-46d2-9634-91024adcf0bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:36:46.878655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d8985-c227-46d2-9634-91024adcf0bb service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:36:46.878943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d8985-c227-46d2-9634-91024adcf0bb service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:36:46.879218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d8985-c227-46d2-9634-91024adcf0bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:36:46.888361 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d8985-c227-46d2-9634-91024adcf0bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:36:46.890033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d8985-c227-46d2-9634-91024adcf0bb service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:36:46.898440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1402/2769] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:36:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:36:56.834399 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:56.894949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:36:59.966458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703924eb-2487-46ce-96f2-80429a1aad87 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:00.032260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703924eb-2487-46ce-96f2-80429a1aad87 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:00.036809 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:00.037805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:00.038090 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:00.038365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] PATH_INFO: `/v3/users/4882d1d39c47445aa4541a3c802797f6` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:00.039592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4882d1d39c47445aa4541a3c802797f6)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:00.041552 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:00.090677 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4882d1d39c47445aa4541a3c802797f6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.090981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4882d1d39c47445aa4541a3c802797f6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.103003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4882d1d39c47445aa4541a3c802797f6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.110155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4882d1d39c47445aa4541a3c802797f6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.110771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4882d1d39c47445aa4541a3c802797f6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.124012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1368/2770] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:36:59 2022] DELETE /identity/v3/users/4882d1d39c47445aa4541a3c802797f6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:00.128582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d85cd-9b0e-40d9-a6f5-fc268eac2ac9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:00.129082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d85cd-9b0e-40d9-a6f5-fc268eac2ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:00.129196 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d85cd-9b0e-40d9-a6f5-fc268eac2ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:00.154942 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-037d85cd-9b0e-40d9-a6f5-fc268eac2ac9 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:00.156218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-037d85cd-9b0e-40d9-a6f5-fc268eac2ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:00.217567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1403/2771] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:00.227356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:00.229068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:00.288259 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b92d3-24d9-45de-b654-b4e18ab186cf admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:00.292030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212895e7-8333-4618-9b7c-47c3f2ea347d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:00.292679 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212895e7-8333-4618-9b7c-47c3f2ea347d service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:00.292960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212895e7-8333-4618-9b7c-47c3f2ea347d service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:00.293237 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212895e7-8333-4618-9b7c-47c3f2ea347d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:00.302529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212895e7-8333-4618-9b7c-47c3f2ea347d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:00.304615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212895e7-8333-4618-9b7c-47c3f2ea347d service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:00.314238 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1369/2772] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:00.581261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d85cd-9b0e-40d9-a6f5-fc268eac2ac9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:00.582816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-037d85cd-9b0e-40d9-a6f5-fc268eac2ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:00.597063 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d85cd-9b0e-40d9-a6f5-fc268eac2ac9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:00.603726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:00.604598 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:00.604878 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:00.605153 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] PATH_INFO: `/v3/projects/33f1b15bac9e421dbd85121c57a204b3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:00.606380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f1b15bac9e421dbd85121c57a204b3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:00.608439 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:00.655009 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f1b15bac9e421dbd85121c57a204b3', 'request_id': 'req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.661109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f1b15bac9e421dbd85121c57a204b3', 'request_id': 'req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.669098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f1b15bac9e421dbd85121c57a204b3', 'request_id': 'req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.679182 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] The token cache is being invalidate because project 33f1b15bac9e421dbd85121c57a204b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:00.679465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.680621 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.682158 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1404/2773] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:00 2022] DELETE /identity/v3/projects/33f1b15bac9e421dbd85121c57a204b3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:37:00.686505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212895e7-8333-4618-9b7c-47c3f2ea347d service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:00.696335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212895e7-8333-4618-9b7c-47c3f2ea347d service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:00.714569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:00.756925 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:00.757816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:00.758096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:00.758376 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] PATH_INFO: `/v3/users/663a026b145248efa3b640c0bae5ca91` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:00.759661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] RBAC: Authorizing `identity:delete_user(user_id=663a026b145248efa3b640c0bae5ca91)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:00.761632 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:00.812850 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663a026b145248efa3b640c0bae5ca91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.813570 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663a026b145248efa3b640c0bae5ca91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.825908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663a026b145248efa3b640c0bae5ca91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.833213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663a026b145248efa3b640c0bae5ca91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.833932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-90b98220-2ba1-484e-8829-947046f6aeda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663a026b145248efa3b640c0bae5ca91'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:00.849307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1370/2774] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:37:00 2022] DELETE /identity/v3/users/663a026b145248efa3b640c0bae5ca91 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:01.147267 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:01.149331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:01.180893 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b0d15-20d3-457d-808e-bfc6311ba6ff admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:01.263590 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:01.264553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.264553 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.264765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] PATH_INFO: `/v3/projects/517a603550214bbbbf3b0368f5d0e77f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.266124 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=517a603550214bbbbf3b0368f5d0e77f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:01.268294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:01.308869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:01.326278 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517a603550214bbbbf3b0368f5d0e77f', 'request_id': 'req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:01.332536 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517a603550214bbbbf3b0368f5d0e77f', 'request_id': 'req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:01.339881 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517a603550214bbbbf3b0368f5d0e77f', 'request_id': 'req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:01.350138 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] The token cache is being invalidate because project 517a603550214bbbbf3b0368f5d0e77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:01.350428 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:01.351614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-128fd2f7-5d2a-4b4e-b690-0f7f1d1b9f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:01.353422 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1405/2775] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:01 2022] DELETE /identity/v3/projects/517a603550214bbbbf3b0368f5d0e77f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:01.358551 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425031c7-3811-4a75-8979-811ebaf8173f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.359062 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425031c7-3811-4a75-8979-811ebaf8173f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.359180 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425031c7-3811-4a75-8979-811ebaf8173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.377393 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-425031c7-3811-4a75-8979-811ebaf8173f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:01.378606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-425031c7-3811-4a75-8979-811ebaf8173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:01.437310 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1371/2776] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:01.445111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce679f2e-cf9d-456d-9fac-0da49cc6e643 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.445403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce679f2e-cf9d-456d-9fac-0da49cc6e643 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.445685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce679f2e-cf9d-456d-9fac-0da49cc6e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.464295 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ce679f2e-cf9d-456d-9fac-0da49cc6e643 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:01.465503 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ce679f2e-cf9d-456d-9fac-0da49cc6e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:01.474045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1406/2777] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:01.478999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425031c7-3811-4a75-8979-811ebaf8173f None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:01.489016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425031c7-3811-4a75-8979-811ebaf8173f None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:01.494394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca8f2-ac09-4a23-8bba-427b4ce1259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:01.495050 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca8f2-ac09-4a23-8bba-427b4ce1259c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.495331 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca8f2-ac09-4a23-8bba-427b4ce1259c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.495637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca8f2-ac09-4a23-8bba-427b4ce1259c admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.496367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca8f2-ac09-4a23-8bba-427b4ce1259c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:37:01.496674 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca8f2-ac09-4a23-8bba-427b4ce1259c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:01.498275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca8f2-ac09-4a23-8bba-427b4ce1259c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:01.510313 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1372/2778] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:37:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:37:01.514692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce679f2e-cf9d-456d-9fac-0da49cc6e643 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:01.524499 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce679f2e-cf9d-456d-9fac-0da49cc6e643 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:01.529543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52441d47-9916-46ed-a594-4a7a2f4fe4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:01.530190 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52441d47-9916-46ed-a594-4a7a2f4fe4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.530471 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52441d47-9916-46ed-a594-4a7a2f4fe4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.530747 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52441d47-9916-46ed-a594-4a7a2f4fe4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.531440 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52441d47-9916-46ed-a594-4a7a2f4fe4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:01.533393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52441d47-9916-46ed-a594-4a7a2f4fe4e1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:01.562444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1407/2779] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:37:01 2022] POST /identity/v3/projects => generated 378 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:01.566735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca8f2-ac09-4a23-8bba-427b4ce1259c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:01.576799 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca8f2-ac09-4a23-8bba-427b4ce1259c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:01.603797 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:01.635096 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645840ea-edf6-4989-9bec-f3e6d38b8026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:01.635798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645840ea-edf6-4989-9bec-f3e6d38b8026 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.636080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645840ea-edf6-4989-9bec-f3e6d38b8026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.636355 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645840ea-edf6-4989-9bec-f3e6d38b8026 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.637042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645840ea-edf6-4989-9bec-f3e6d38b8026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:01.638951 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645840ea-edf6-4989-9bec-f3e6d38b8026 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:01.660888 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1373/2780] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:37:01 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:37:01.665734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52441d47-9916-46ed-a594-4a7a2f4fe4e1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:01.676172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52441d47-9916-46ed-a594-4a7a2f4fe4e1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:01.680825 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392d0af-7c19-4c74-8771-bb49a2bc1af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:01.681491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d0af-7c19-4c74-8771-bb49a2bc1af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.681817 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d0af-7c19-4c74-8771-bb49a2bc1af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.682103 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d0af-7c19-4c74-8771-bb49a2bc1af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.682833 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392d0af-7c19-4c74-8771-bb49a2bc1af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:01.684486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392d0af-7c19-4c74-8771-bb49a2bc1af0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:01.695932 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1408/2781] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:01 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:01.700016 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645840ea-edf6-4989-9bec-f3e6d38b8026 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:01.710168 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645840ea-edf6-4989-9bec-f3e6d38b8026 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:01.715405 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c9cc3-99f3-4bdb-8695-1da638fc62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:01.716104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9cc3-99f3-4bdb-8695-1da638fc62ea admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.716389 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9cc3-99f3-4bdb-8695-1da638fc62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.716699 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9cc3-99f3-4bdb-8695-1da638fc62ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.717426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c9cc3-99f3-4bdb-8695-1da638fc62ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:01.719065 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c9cc3-99f3-4bdb-8695-1da638fc62ea admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:01.730086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1374/2782] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:01 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:01.734095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392d0af-7c19-4c74-8771-bb49a2bc1af0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:01.744161 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392d0af-7c19-4c74-8771-bb49a2bc1af0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:01.748955 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6db232-4919-4e1f-bc1d-85385b875d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:01.749847 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db232-4919-4e1f-bc1d-85385b875d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.750117 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db232-4919-4e1f-bc1d-85385b875d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.750393 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6db232-4919-4e1f-bc1d-85385b875d15 admin admin] PATH_INFO: `/v3/projects/639b50d87edf44f48285d3a6b2fcae65/users/466d2e632ad545178642c5b61a1058a4/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.764838 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6db232-4919-4e1f-bc1d-85385b875d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639b50d87edf44f48285d3a6b2fcae65, user_id=466d2e632ad545178642c5b61a1058a4, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:01.767485 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6db232-4919-4e1f-bc1d-85385b875d15 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:01.780859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1409/2783] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:01 2022] PUT /identity/v3/projects/639b50d87edf44f48285d3a6b2fcae65/users/466d2e632ad545178642c5b61a1058a4/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:01.792785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ddd07-a265-4b8c-995f-0fcb786ff01c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.793083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ddd07-a265-4b8c-995f-0fcb786ff01c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.793368 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ddd07-a265-4b8c-995f-0fcb786ff01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.819689 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-098ddd07-a265-4b8c-995f-0fcb786ff01c None None] MFA Rules not processed for user `466d2e632ad545178642c5b61a1058a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:01.820953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-098ddd07-a265-4b8c-995f-0fcb786ff01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:01.887501 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1375/2784] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:01.892318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6db232-4919-4e1f-bc1d-85385b875d15 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:01.953322 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6db232-4919-4e1f-bc1d-85385b875d15 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:01.958014 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eb6eb-b877-4718-92ec-f2df56514fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:01.958663 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eb6eb-b877-4718-92ec-f2df56514fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:01.958950 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eb6eb-b877-4718-92ec-f2df56514fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:01.959233 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eb6eb-b877-4718-92ec-f2df56514fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:01.959951 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000eb6eb-b877-4718-92ec-f2df56514fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:01.962389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000eb6eb-b877-4718-92ec-f2df56514fa2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:01.987988 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1410/2785] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:37:01 2022] POST /identity/v3/projects => generated 378 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:37:01.992179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ddd07-a265-4b8c-995f-0fcb786ff01c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:02.002939 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ddd07-a265-4b8c-995f-0fcb786ff01c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:02.058272 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856e588-071b-4ddf-bb45-bdc9e49126ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:02.058943 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856e588-071b-4ddf-bb45-bdc9e49126ec admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:02.059228 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856e588-071b-4ddf-bb45-bdc9e49126ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:02.059504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856e588-071b-4ddf-bb45-bdc9e49126ec admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:02.060242 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856e588-071b-4ddf-bb45-bdc9e49126ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:02.062805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856e588-071b-4ddf-bb45-bdc9e49126ec admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:02.084304 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1376/2786] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:37:01 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:02.088863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eb6eb-b877-4718-92ec-f2df56514fa2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:02.099054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eb6eb-b877-4718-92ec-f2df56514fa2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:02.104016 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683e449-090e-4006-9c6b-4ff4df9d07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:02.104666 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683e449-090e-4006-9c6b-4ff4df9d07e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:02.104947 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683e449-090e-4006-9c6b-4ff4df9d07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:02.105222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683e449-090e-4006-9c6b-4ff4df9d07e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:02.105934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683e449-090e-4006-9c6b-4ff4df9d07e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:02.107521 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683e449-090e-4006-9c6b-4ff4df9d07e9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:02.117973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1411/2787] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:02 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:02.122069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856e588-071b-4ddf-bb45-bdc9e49126ec admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:02.132100 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856e588-071b-4ddf-bb45-bdc9e49126ec admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:02.137308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974020-7d80-41d8-add1-adcd7c42ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:02.138189 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974020-7d80-41d8-add1-adcd7c42ab2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:02.138469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974020-7d80-41d8-add1-adcd7c42ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:02.138743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974020-7d80-41d8-add1-adcd7c42ab2d admin admin] PATH_INFO: `/v3/projects/7e4b0e544c7c41f2b1d298b93fd95954/users/e75f3495042a46afa3fb5fe1b7d9f3ed/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:02.154390 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974020-7d80-41d8-add1-adcd7c42ab2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4b0e544c7c41f2b1d298b93fd95954, user_id=e75f3495042a46afa3fb5fe1b7d9f3ed, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:02.157114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974020-7d80-41d8-add1-adcd7c42ab2d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:02.170560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1377/2788] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:02 2022] PUT /identity/v3/projects/7e4b0e544c7c41f2b1d298b93fd95954/users/e75f3495042a46afa3fb5fe1b7d9f3ed/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:02.174739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683e449-090e-4006-9c6b-4ff4df9d07e9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:02.184943 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683e449-090e-4006-9c6b-4ff4df9d07e9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:02.205099 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:02.251953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ade9c-3d86-40ab-a0fd-a2490169f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:02.252546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ade9c-3d86-40ab-a0fd-a2490169f73e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:02.252835 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ade9c-3d86-40ab-a0fd-a2490169f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:02.253211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ade9c-3d86-40ab-a0fd-a2490169f73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:02.254467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ade9c-3d86-40ab-a0fd-a2490169f73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:02.256101 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ade9c-3d86-40ab-a0fd-a2490169f73e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:02.266842 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1412/2789] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:02 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:02.271221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974020-7d80-41d8-add1-adcd7c42ab2d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:02.277338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:02.283796 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974020-7d80-41d8-add1-adcd7c42ab2d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:02.288905 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dfca1-e4bd-4f58-afba-745af403095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:02.289781 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfca1-e4bd-4f58-afba-745af403095d admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:02.290064 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfca1-e4bd-4f58-afba-745af403095d admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:02.290456 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dfca1-e4bd-4f58-afba-745af403095d admin admin] PATH_INFO: `/v3/projects/7e4b0e544c7c41f2b1d298b93fd95954/users/e75f3495042a46afa3fb5fe1b7d9f3ed/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:02.292518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dfca1-e4bd-4f58-afba-745af403095d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4b0e544c7c41f2b1d298b93fd95954, user_id=e75f3495042a46afa3fb5fe1b7d9f3ed, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:02.295173 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dfca1-e4bd-4f58-afba-745af403095d admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:02.306575 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1378/2790] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:02 2022] PUT /identity/v3/projects/7e4b0e544c7c41f2b1d298b93fd95954/users/e75f3495042a46afa3fb5fe1b7d9f3ed/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:02.316719 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ece2fd-6c1b-47f7-80a0-344cd9a4bde1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:02.317018 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ece2fd-6c1b-47f7-80a0-344cd9a4bde1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:02.317302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ece2fd-6c1b-47f7-80a0-344cd9a4bde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:02.345759 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a2ece2fd-6c1b-47f7-80a0-344cd9a4bde1 None None] MFA Rules not processed for user `e75f3495042a46afa3fb5fe1b7d9f3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:02.346970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a2ece2fd-6c1b-47f7-80a0-344cd9a4bde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:02.419637 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1413/2791] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:02.430522 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dfca1-e4bd-4f58-afba-745af403095d admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:02.432262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-036dfca1-e4bd-4f58-afba-745af403095d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:02.494841 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dfca1-e4bd-4f58-afba-745af403095d admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:02.498685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c278d1-9cf6-46a3-a1cc-8d2a1ce8116c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:02.499423 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c278d1-9cf6-46a3-a1cc-8d2a1ce8116c service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:02.499812 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c278d1-9cf6-46a3-a1cc-8d2a1ce8116c service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:02.500159 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c278d1-9cf6-46a3-a1cc-8d2a1ce8116c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:02.559638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c278d1-9cf6-46a3-a1cc-8d2a1ce8116c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:02.560997 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c278d1-9cf6-46a3-a1cc-8d2a1ce8116c service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:02.570597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1379/2792] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:05.126309 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ece2fd-6c1b-47f7-80a0-344cd9a4bde1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:05.136566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ece2fd-6c1b-47f7-80a0-344cd9a4bde1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:05.140079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a42dc-4d0b-4c95-9779-b96cbaed3c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:05.140711 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a42dc-4d0b-4c95-9779-b96cbaed3c9e service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:05.140996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a42dc-4d0b-4c95-9779-b96cbaed3c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:05.141274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a42dc-4d0b-4c95-9779-b96cbaed3c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:05.151033 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a42dc-4d0b-4c95-9779-b96cbaed3c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:05.152573 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a42dc-4d0b-4c95-9779-b96cbaed3c9e service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:05.162560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1414/2793] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:06.172638 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c278d1-9cf6-46a3-a1cc-8d2a1ce8116c service cinder] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:06.174276 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-58c278d1-9cf6-46a3-a1cc-8d2a1ce8116c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:06.232815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c278d1-9cf6-46a3-a1cc-8d2a1ce8116c service cinder] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:06.236492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7892061-b5fb-4d13-b8da-262f33be6a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:06.237151 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7892061-b5fb-4d13-b8da-262f33be6a7a service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:06.237435 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7892061-b5fb-4d13-b8da-262f33be6a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:06.237713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7892061-b5fb-4d13-b8da-262f33be6a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:06.239505 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a7892061-b5fb-4d13-b8da-262f33be6a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:06.298204 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:06.303035 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7892061-b5fb-4d13-b8da-262f33be6a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:06.305528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7892061-b5fb-4d13-b8da-262f33be6a7a service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:06.315171 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1380/2794] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:15.158413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=58 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:16.310920 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:17.714606 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a42dc-4d0b-4c95-9779-b96cbaed3c9e service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:17.778467 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a42dc-4d0b-4c95-9779-b96cbaed3c9e service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:17.783059 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:17.783969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:17.784255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:17.784532 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] PATH_INFO: `/v3/users/466d2e632ad545178642c5b61a1058a4` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:17.785734 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466d2e632ad545178642c5b61a1058a4)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:17.787707 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:17.835567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466d2e632ad545178642c5b61a1058a4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:17.836754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466d2e632ad545178642c5b61a1058a4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:17.843733 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466d2e632ad545178642c5b61a1058a4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:17.844357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466d2e632ad545178642c5b61a1058a4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:17.852732 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466d2e632ad545178642c5b61a1058a4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:17.870048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1415/2795] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:37:17 2022] DELETE /identity/v3/users/466d2e632ad545178642c5b61a1058a4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:17.874687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48cf58-c9e3-4bbe-a6f5-c09e298b9a3a None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:17.875202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48cf58-c9e3-4bbe-a6f5-c09e298b9a3a None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:17.875307 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48cf58-c9e3-4bbe-a6f5-c09e298b9a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:17.892687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-9a48cf58-c9e3-4bbe-a6f5-c09e298b9a3a None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:17.893922 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9a48cf58-c9e3-4bbe-a6f5-c09e298b9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:17.954554 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1381/2796] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:17.964565 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:17.966019 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:18.024085 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076384c4-e91e-4a65-98a3-b6e13da1dd70 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:18.027715 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284fc57-1bea-4bcd-9a9e-b2a6a558b922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:18.028371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284fc57-1bea-4bcd-9a9e-b2a6a558b922 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:18.028640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284fc57-1bea-4bcd-9a9e-b2a6a558b922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:18.028917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284fc57-1bea-4bcd-9a9e-b2a6a558b922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:18.037959 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284fc57-1bea-4bcd-9a9e-b2a6a558b922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:18.039983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284fc57-1bea-4bcd-9a9e-b2a6a558b922 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:18.049543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1416/2797] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:18.322838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48cf58-c9e3-4bbe-a6f5-c09e298b9a3a None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:18.324358 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-9a48cf58-c9e3-4bbe-a6f5-c09e298b9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:18.337070 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48cf58-c9e3-4bbe-a6f5-c09e298b9a3a None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:18.341764 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:18.342648 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:18.343054 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:18.343213 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] PATH_INFO: `/v3/projects/639b50d87edf44f48285d3a6b2fcae65` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:18.344434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=639b50d87edf44f48285d3a6b2fcae65)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:18.346372 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:18.396590 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639b50d87edf44f48285d3a6b2fcae65', 'request_id': 'req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.403249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639b50d87edf44f48285d3a6b2fcae65', 'request_id': 'req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.410744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639b50d87edf44f48285d3a6b2fcae65', 'request_id': 'req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.420991 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] The token cache is being invalidate because project 639b50d87edf44f48285d3a6b2fcae65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:18.421283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.421976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.423640 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1382/2798] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:18 2022] DELETE /identity/v3/projects/639b50d87edf44f48285d3a6b2fcae65 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:18.427632 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284fc57-1bea-4bcd-9a9e-b2a6a558b922 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:18.437281 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284fc57-1bea-4bcd-9a9e-b2a6a558b922 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:18.455618 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:18.495403 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:18.496299 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:18.496587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:18.496865 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] PATH_INFO: `/v3/users/e75f3495042a46afa3fb5fe1b7d9f3ed` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:18.498061 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75f3495042a46afa3fb5fe1b7d9f3ed)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:18.500042 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:18.545336 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75f3495042a46afa3fb5fe1b7d9f3ed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.545987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75f3495042a46afa3fb5fe1b7d9f3ed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.552964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75f3495042a46afa3fb5fe1b7d9f3ed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.553601 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75f3495042a46afa3fb5fe1b7d9f3ed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.561067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed7ef8f2-a99d-4540-ab0e-91f9cb72873c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75f3495042a46afa3fb5fe1b7d9f3ed'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:18.580331 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1417/2799] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:37:18 2022] DELETE /identity/v3/users/e75f3495042a46afa3fb5fe1b7d9f3ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:18.864917 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:18.866537 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:18.880684 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962d8c4-6fc2-41dc-a01a-36cd71c7cc9b admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:18.937531 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:18.938395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:18.938681 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:18.938960 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] PATH_INFO: `/v3/projects/7e4b0e544c7c41f2b1d298b93fd95954` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:18.940169 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4b0e544c7c41f2b1d298b93fd95954)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:18.942157 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:18.972847 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:18.990485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4b0e544c7c41f2b1d298b93fd95954', 'request_id': 'req-7eed2ebe-7553-46be-ac7e-255087fc1267'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:19.001227 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4b0e544c7c41f2b1d298b93fd95954', 'request_id': 'req-7eed2ebe-7553-46be-ac7e-255087fc1267'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:19.009123 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4b0e544c7c41f2b1d298b93fd95954', 'request_id': 'req-7eed2ebe-7553-46be-ac7e-255087fc1267'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:19.019507 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] The token cache is being invalidate because project 7e4b0e544c7c41f2b1d298b93fd95954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:19.019827 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:19.020458 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-7eed2ebe-7553-46be-ac7e-255087fc1267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:19.022027 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1383/2800] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:18 2022] DELETE /identity/v3/projects/7e4b0e544c7c41f2b1d298b93fd95954 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:19.027226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761353a3-dacb-415f-bbb3-71ae76213599 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.027726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761353a3-dacb-415f-bbb3-71ae76213599 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.027937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761353a3-dacb-415f-bbb3-71ae76213599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.047030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-761353a3-dacb-415f-bbb3-71ae76213599 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:19.048289 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-761353a3-dacb-415f-bbb3-71ae76213599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:19.243956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1418/2801] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:19.252603 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443deb74-4ccf-41a9-af20-7536976ce415 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.252895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443deb74-4ccf-41a9-af20-7536976ce415 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.253178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443deb74-4ccf-41a9-af20-7536976ce415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.271083 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-443deb74-4ccf-41a9-af20-7536976ce415 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:19.272315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-443deb74-4ccf-41a9-af20-7536976ce415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:19.280120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1384/2802] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:19.284345 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761353a3-dacb-415f-bbb3-71ae76213599 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.294841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761353a3-dacb-415f-bbb3-71ae76213599 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.299480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40ae50-e3ff-4dec-805a-107209c92401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.300181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40ae50-e3ff-4dec-805a-107209c92401 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.300460 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40ae50-e3ff-4dec-805a-107209c92401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.300735 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40ae50-e3ff-4dec-805a-107209c92401 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.301453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40ae50-e3ff-4dec-805a-107209c92401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:37:19.301808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40ae50-e3ff-4dec-805a-107209c92401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.303374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40ae50-e3ff-4dec-805a-107209c92401 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:19.315359 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1419/2803] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:37:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:37:19.319756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443deb74-4ccf-41a9-af20-7536976ce415 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.329080 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443deb74-4ccf-41a9-af20-7536976ce415 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.333786 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe4e2f-101c-4d3f-b154-59434a4aa9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.334427 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe4e2f-101c-4d3f-b154-59434a4aa9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.334711 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe4e2f-101c-4d3f-b154-59434a4aa9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.334988 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe4e2f-101c-4d3f-b154-59434a4aa9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.335713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe4e2f-101c-4d3f-b154-59434a4aa9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.337601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe4e2f-101c-4d3f-b154-59434a4aa9e2 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:19.363210 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1385/2804] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:37:19 2022] POST /identity/v3/projects => generated 400 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:19.368112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40ae50-e3ff-4dec-805a-107209c92401 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.378235 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40ae50-e3ff-4dec-805a-107209c92401 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.403072 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:19.436297 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec314-7bde-46d3-8540-1ada53a6b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.436939 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec314-7bde-46d3-8540-1ada53a6b6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.437218 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec314-7bde-46d3-8540-1ada53a6b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.437488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec314-7bde-46d3-8540-1ada53a6b6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.438168 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ec314-7bde-46d3-8540-1ada53a6b6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.440100 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ec314-7bde-46d3-8540-1ada53a6b6b8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:19.458643 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1420/2805] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:37:19 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:19.462794 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe4e2f-101c-4d3f-b154-59434a4aa9e2 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.473256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe4e2f-101c-4d3f-b154-59434a4aa9e2 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.478633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912ef2a-c6dd-49c2-9728-e288c17cf1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.479569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912ef2a-c6dd-49c2-9728-e288c17cf1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.479866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912ef2a-c6dd-49c2-9728-e288c17cf1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.480172 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912ef2a-c6dd-49c2-9728-e288c17cf1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.480931 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912ef2a-c6dd-49c2-9728-e288c17cf1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.482615 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912ef2a-c6dd-49c2-9728-e288c17cf1eb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:19.493120 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1386/2806] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:19 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:19.497101 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec314-7bde-46d3-8540-1ada53a6b6b8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.506967 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec314-7bde-46d3-8540-1ada53a6b6b8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.512082 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a64ac6-094b-49e3-9540-24ee4175781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.512729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64ac6-094b-49e3-9540-24ee4175781a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.513007 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64ac6-094b-49e3-9540-24ee4175781a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.513276 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64ac6-094b-49e3-9540-24ee4175781a admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.514004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64ac6-094b-49e3-9540-24ee4175781a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.515578 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64ac6-094b-49e3-9540-24ee4175781a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:19.526261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1421/2807] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:19 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:19.529892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912ef2a-c6dd-49c2-9728-e288c17cf1eb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.540150 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912ef2a-c6dd-49c2-9728-e288c17cf1eb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.544766 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a47aa-d57f-44a3-91d3-f970c90a2139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.545633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a47aa-d57f-44a3-91d3-f970c90a2139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.545914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a47aa-d57f-44a3-91d3-f970c90a2139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.546190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a47aa-d57f-44a3-91d3-f970c90a2139 admin admin] PATH_INFO: `/v3/projects/c2ac5a5b0e2548d498d0407c7c640065/users/c76920888d1b4e6e998737368e8812c2/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.561740 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a47aa-d57f-44a3-91d3-f970c90a2139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ac5a5b0e2548d498d0407c7c640065, user_id=c76920888d1b4e6e998737368e8812c2, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.564524 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a47aa-d57f-44a3-91d3-f970c90a2139 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:19.578504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1387/2808] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:19 2022] PUT /identity/v3/projects/c2ac5a5b0e2548d498d0407c7c640065/users/c76920888d1b4e6e998737368e8812c2/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:19.640610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87712ab-fb18-4bbc-a1d3-042ad8c9821b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.640899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87712ab-fb18-4bbc-a1d3-042ad8c9821b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.641187 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87712ab-fb18-4bbc-a1d3-042ad8c9821b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.666741 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b87712ab-fb18-4bbc-a1d3-042ad8c9821b None None] MFA Rules not processed for user `c76920888d1b4e6e998737368e8812c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:19.667982 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b87712ab-fb18-4bbc-a1d3-042ad8c9821b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:19.730768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1422/2809] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:19.735357 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a47aa-d57f-44a3-91d3-f970c90a2139 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.796878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a47aa-d57f-44a3-91d3-f970c90a2139 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.801488 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057650ba-b1a0-4879-9884-2ff3148553cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.802140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057650ba-b1a0-4879-9884-2ff3148553cb admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.802426 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057650ba-b1a0-4879-9884-2ff3148553cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.802703 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057650ba-b1a0-4879-9884-2ff3148553cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.803385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057650ba-b1a0-4879-9884-2ff3148553cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.805838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057650ba-b1a0-4879-9884-2ff3148553cb admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:19.831067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1388/2810] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:37:19 2022] POST /identity/v3/projects => generated 400 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:19.835274 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87712ab-fb18-4bbc-a1d3-042ad8c9821b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.845805 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87712ab-fb18-4bbc-a1d3-042ad8c9821b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.900453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27df121-61ec-45ca-b65a-cbe3a53b2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.901113 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27df121-61ec-45ca-b65a-cbe3a53b2ded admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.901396 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27df121-61ec-45ca-b65a-cbe3a53b2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.901670 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27df121-61ec-45ca-b65a-cbe3a53b2ded admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.902362 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27df121-61ec-45ca-b65a-cbe3a53b2ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.904320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27df121-61ec-45ca-b65a-cbe3a53b2ded admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:19.924169 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1423/2811] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:37:19 2022] POST /identity/v3/users => generated 307 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:19.928288 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057650ba-b1a0-4879-9884-2ff3148553cb admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.939400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057650ba-b1a0-4879-9884-2ff3148553cb admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.944060 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afe4c7-2183-440d-aab8-46810ae7d4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.944718 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afe4c7-2183-440d-aab8-46810ae7d4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.945000 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afe4c7-2183-440d-aab8-46810ae7d4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.945277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afe4c7-2183-440d-aab8-46810ae7d4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.946007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afe4c7-2183-440d-aab8-46810ae7d4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.947631 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afe4c7-2183-440d-aab8-46810ae7d4e4 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:19.958111 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1389/2812] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:19 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:19.962176 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27df121-61ec-45ca-b65a-cbe3a53b2ded admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:19.972030 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27df121-61ec-45ca-b65a-cbe3a53b2ded admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:19.977137 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e006-3030-4041-86a4-d47e3c919245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:19.978002 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e006-3030-4041-86a4-d47e3c919245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:19.978282 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e006-3030-4041-86a4-d47e3c919245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:19.978560 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e006-3030-4041-86a4-d47e3c919245 admin admin] PATH_INFO: `/v3/projects/5cdf99df54f94c7bbd15d26d214a8ad5/users/1ebefae9168149d18cd789df72bcd674/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:19.993300 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637e006-3030-4041-86a4-d47e3c919245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdf99df54f94c7bbd15d26d214a8ad5, user_id=1ebefae9168149d18cd789df72bcd674, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:19.995949 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637e006-3030-4041-86a4-d47e3c919245 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:20.009171 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1424/2813] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:19 2022] PUT /identity/v3/projects/5cdf99df54f94c7bbd15d26d214a8ad5/users/1ebefae9168149d18cd789df72bcd674/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 16:37:20.013092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afe4c7-2183-440d-aab8-46810ae7d4e4 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:20.024015 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afe4c7-2183-440d-aab8-46810ae7d4e4 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:20.043545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:20.081528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee8556-76aa-4e73-b006-91ec192b8e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:20.082110 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee8556-76aa-4e73-b006-91ec192b8e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:20.082387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee8556-76aa-4e73-b006-91ec192b8e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:20.082658 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee8556-76aa-4e73-b006-91ec192b8e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:20.083470 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee8556-76aa-4e73-b006-91ec192b8e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:20.084998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee8556-76aa-4e73-b006-91ec192b8e19 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:20.095601 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1390/2814] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:20 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:20.099821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e006-3030-4041-86a4-d47e3c919245 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:20.105508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:20.111650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e006-3030-4041-86a4-d47e3c919245 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:20.116694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600c53d-9dff-4314-b8c2-ce718b023b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:20.117559 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600c53d-9dff-4314-b8c2-ce718b023b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:20.117836 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600c53d-9dff-4314-b8c2-ce718b023b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:20.118109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600c53d-9dff-4314-b8c2-ce718b023b55 admin admin] PATH_INFO: `/v3/projects/5cdf99df54f94c7bbd15d26d214a8ad5/users/1ebefae9168149d18cd789df72bcd674/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:20.120088 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600c53d-9dff-4314-b8c2-ce718b023b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cdf99df54f94c7bbd15d26d214a8ad5, user_id=1ebefae9168149d18cd789df72bcd674, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:20.122671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600c53d-9dff-4314-b8c2-ce718b023b55 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:20.133426 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1425/2815] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:20 2022] PUT /identity/v3/projects/5cdf99df54f94c7bbd15d26d214a8ad5/users/1ebefae9168149d18cd789df72bcd674/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:20.143710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ca1b-0829-4f3d-a47c-bc67fb14d6af None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:20.143998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ca1b-0829-4f3d-a47c-bc67fb14d6af None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:20.144277 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ca1b-0829-4f3d-a47c-bc67fb14d6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:20.172352 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1af1ca1b-0829-4f3d-a47c-bc67fb14d6af None None] MFA Rules not processed for user `1ebefae9168149d18cd789df72bcd674`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:20.173553 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1af1ca1b-0829-4f3d-a47c-bc67fb14d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:20.242785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1391/2816] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:20 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:37:20.253484 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600c53d-9dff-4314-b8c2-ce718b023b55 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:20.255263 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6600c53d-9dff-4314-b8c2-ce718b023b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:20.313349 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600c53d-9dff-4314-b8c2-ce718b023b55 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:20.317048 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86560c67-2e64-44d9-801a-ca0fc795adb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:20.317689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86560c67-2e64-44d9-801a-ca0fc795adb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:20.317975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86560c67-2e64-44d9-801a-ca0fc795adb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:20.318253 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86560c67-2e64-44d9-801a-ca0fc795adb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:20.327806 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86560c67-2e64-44d9-801a-ca0fc795adb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:20.329234 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86560c67-2e64-44d9-801a-ca0fc795adb8 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:20.338605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1426/2817] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:20 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:20.410018 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ca1b-0829-4f3d-a47c-bc67fb14d6af None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:20.419864 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ca1b-0829-4f3d-a47c-bc67fb14d6af None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:20.423493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fce70-e547-44a4-aeb3-88190a3fd1ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:20.424155 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fce70-e547-44a4-aeb3-88190a3fd1ae service cinder] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:20.424437 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fce70-e547-44a4-aeb3-88190a3fd1ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:20.424720 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fce70-e547-44a4-aeb3-88190a3fd1ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:20.483854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fce70-e547-44a4-aeb3-88190a3fd1ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:20.485314 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fce70-e547-44a4-aeb3-88190a3fd1ae service cinder] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:20.494805 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1392/2818] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:24.527154 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86560c67-2e64-44d9-801a-ca0fc795adb8 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:24.589843 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86560c67-2e64-44d9-801a-ca0fc795adb8 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:24.594897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:24.595824 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:24.596105 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:24.596378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] PATH_INFO: `/v3/users/c76920888d1b4e6e998737368e8812c2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:24.597694 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76920888d1b4e6e998737368e8812c2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:24.599687 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:24.651869 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76920888d1b4e6e998737368e8812c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:24.652566 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76920888d1b4e6e998737368e8812c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:24.659794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76920888d1b4e6e998737368e8812c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:24.660525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76920888d1b4e6e998737368e8812c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:24.669074 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76920888d1b4e6e998737368e8812c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:24.687360 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1427/2819] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:37:24 2022] DELETE /identity/v3/users/c76920888d1b4e6e998737368e8812c2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:24.692061 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df786d4b-3986-4d59-8fc7-49239ae56fa5 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:24.692545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df786d4b-3986-4d59-8fc7-49239ae56fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:24.692545 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df786d4b-3986-4d59-8fc7-49239ae56fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:24.709735 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-df786d4b-3986-4d59-8fc7-49239ae56fa5 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:24.711521 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-df786d4b-3986-4d59-8fc7-49239ae56fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:24.751019 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:24.770434 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1393/2820] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:24.780816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:24.782214 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:24.795903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:24.840246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63524545-cb2c-4f1d-a2d3-c8e3c75d16dc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:24.844065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f2a07-8faa-4581-a0d5-fc31216595fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:24.844717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f2a07-8faa-4581-a0d5-fc31216595fe service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:24.844998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f2a07-8faa-4581-a0d5-fc31216595fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:24.845270 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f2a07-8faa-4581-a0d5-fc31216595fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:24.854866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f2a07-8faa-4581-a0d5-fc31216595fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:24.856320 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f2a07-8faa-4581-a0d5-fc31216595fe service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:24.865587 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1428/2821] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:25.142489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df786d4b-3986-4d59-8fc7-49239ae56fa5 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:25.144007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-df786d4b-3986-4d59-8fc7-49239ae56fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:25.156258 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df786d4b-3986-4d59-8fc7-49239ae56fa5 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:25.163429 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:25.164838 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:25.165140 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:25.165540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] PATH_INFO: `/v3/projects/c2ac5a5b0e2548d498d0407c7c640065` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:25.166756 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ac5a5b0e2548d498d0407c7c640065)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:25.168754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:25.216955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ac5a5b0e2548d498d0407c7c640065', 'request_id': 'req-ba47b2d5-1518-4dd4-9110-a65ab2450987'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.223830 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ac5a5b0e2548d498d0407c7c640065', 'request_id': 'req-ba47b2d5-1518-4dd4-9110-a65ab2450987'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.232785 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ac5a5b0e2548d498d0407c7c640065', 'request_id': 'req-ba47b2d5-1518-4dd4-9110-a65ab2450987'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.244030 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] The token cache is being invalidate because project c2ac5a5b0e2548d498d0407c7c640065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:25.244325 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.244953 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.246504 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1394/2822] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:25 2022] DELETE /identity/v3/projects/c2ac5a5b0e2548d498d0407c7c640065 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:25.250622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f2a07-8faa-4581-a0d5-fc31216595fe service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:25.260191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f2a07-8faa-4581-a0d5-fc31216595fe service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:25.316483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:25.317348 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:25.317635 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:25.317912 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] PATH_INFO: `/v3/users/1ebefae9168149d18cd789df72bcd674` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:25.319108 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebefae9168149d18cd789df72bcd674)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:25.321092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:25.366476 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebefae9168149d18cd789df72bcd674'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.367852 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebefae9168149d18cd789df72bcd674'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.374883 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebefae9168149d18cd789df72bcd674'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.375531 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebefae9168149d18cd789df72bcd674'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.382867 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e60359a8-1c77-4be7-b598-aece0887d3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebefae9168149d18cd789df72bcd674'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.400107 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1429/2823] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:37:25 2022] DELETE /identity/v3/users/1ebefae9168149d18cd789df72bcd674 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:25.671275 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:25.672747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:25.687798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b2d5-1518-4dd4-9110-a65ab2450987 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:25.760493 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:25.761256 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:25.761536 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:25.761810 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] PATH_INFO: `/v3/projects/5cdf99df54f94c7bbd15d26d214a8ad5` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:25.762971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cdf99df54f94c7bbd15d26d214a8ad5)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:25.764915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:25.813971 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cdf99df54f94c7bbd15d26d214a8ad5', 'request_id': 'req-530b4fca-4d03-4137-9840-786649536b3c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.820646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cdf99df54f94c7bbd15d26d214a8ad5', 'request_id': 'req-530b4fca-4d03-4137-9840-786649536b3c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.827789 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cdf99df54f94c7bbd15d26d214a8ad5', 'request_id': 'req-530b4fca-4d03-4137-9840-786649536b3c'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.833945 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:25.839265 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] The token cache is being invalidate because project 5cdf99df54f94c7bbd15d26d214a8ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80221) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:25.839845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.841004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-530b4fca-4d03-4137-9840-786649536b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:25.842737 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1395/2824] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:25 2022] DELETE /identity/v3/projects/5cdf99df54f94c7bbd15d26d214a8ad5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:25.847871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29007-255a-412a-b245-55df764ba86f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:25.848416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29007-255a-412a-b245-55df764ba86f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:25.848581 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29007-255a-412a-b245-55df764ba86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:25.867528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8eb29007-255a-412a-b245-55df764ba86f None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:25.868765 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8eb29007-255a-412a-b245-55df764ba86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:25.897318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:25.931911 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1430/2825] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:37:25.940994 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67858fff-7731-48e0-9040-f11d032a1da6 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:25.941285 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67858fff-7731-48e0-9040-f11d032a1da6 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:25.941566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67858fff-7731-48e0-9040-f11d032a1da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:25.959668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-67858fff-7731-48e0-9040-f11d032a1da6 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:25.960863 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-67858fff-7731-48e0-9040-f11d032a1da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:25.968768 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1396/2826] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:25.972918 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29007-255a-412a-b245-55df764ba86f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:25.983394 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29007-255a-412a-b245-55df764ba86f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:25.988054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b389-e6fa-4368-a026-6aaa487f8bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:25.988700 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b389-e6fa-4368-a026-6aaa487f8bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:25.988984 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b389-e6fa-4368-a026-6aaa487f8bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:25.989261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632b389-e6fa-4368-a026-6aaa487f8bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:25.989991 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632b389-e6fa-4368-a026-6aaa487f8bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:37:25.990302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632b389-e6fa-4368-a026-6aaa487f8bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:25.992459 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632b389-e6fa-4368-a026-6aaa487f8bcb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.003786 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1431/2827] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:37:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:37:26.008042 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67858fff-7731-48e0-9040-f11d032a1da6 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.017364 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67858fff-7731-48e0-9040-f11d032a1da6 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.021927 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365a108-26ed-47ee-90fa-f4a78b98cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.022564 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365a108-26ed-47ee-90fa-f4a78b98cac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.022844 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365a108-26ed-47ee-90fa-f4a78b98cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.023122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365a108-26ed-47ee-90fa-f4a78b98cac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.023848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365a108-26ed-47ee-90fa-f4a78b98cac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.025775 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365a108-26ed-47ee-90fa-f4a78b98cac9 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.051354 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1397/2828] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:37:26 2022] POST /identity/v3/projects => generated 386 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:26.056119 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b389-e6fa-4368-a026-6aaa487f8bcb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.066680 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632b389-e6fa-4368-a026-6aaa487f8bcb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.121246 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e98d96-c1a1-408d-bcd3-6aca54d6c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.122010 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e98d96-c1a1-408d-bcd3-6aca54d6c915 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.122293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e98d96-c1a1-408d-bcd3-6aca54d6c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.122567 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e98d96-c1a1-408d-bcd3-6aca54d6c915 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.123261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e98d96-c1a1-408d-bcd3-6aca54d6c915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.125197 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e98d96-c1a1-408d-bcd3-6aca54d6c915 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.145639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1432/2829] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:37:26 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:26.150484 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365a108-26ed-47ee-90fa-f4a78b98cac9 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.161350 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365a108-26ed-47ee-90fa-f4a78b98cac9 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.166135 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4219465-e3d2-4537-a90d-40bea5e89616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.166807 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4219465-e3d2-4537-a90d-40bea5e89616 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.167092 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4219465-e3d2-4537-a90d-40bea5e89616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.167396 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4219465-e3d2-4537-a90d-40bea5e89616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.168218 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4219465-e3d2-4537-a90d-40bea5e89616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.169878 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4219465-e3d2-4537-a90d-40bea5e89616 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.180651 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1398/2830] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:26 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:26.184768 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e98d96-c1a1-408d-bcd3-6aca54d6c915 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.194686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e98d96-c1a1-408d-bcd3-6aca54d6c915 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.199872 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ce98-dde1-4513-a2b4-38dcbcd0d7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.200526 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ce98-dde1-4513-a2b4-38dcbcd0d7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.200813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ce98-dde1-4513-a2b4-38dcbcd0d7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.201093 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ce98-dde1-4513-a2b4-38dcbcd0d7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.201819 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801ce98-dde1-4513-a2b4-38dcbcd0d7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.203400 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801ce98-dde1-4513-a2b4-38dcbcd0d7f0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.213815 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1433/2831] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:26 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:26.218021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4219465-e3d2-4537-a90d-40bea5e89616 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.228324 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4219465-e3d2-4537-a90d-40bea5e89616 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.233254 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0ca7a-dfbd-4f90-89b6-c7632b96750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.234130 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0ca7a-dfbd-4f90-89b6-c7632b96750f admin admin] REQUEST_METHOD: `PUT` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.234406 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0ca7a-dfbd-4f90-89b6-c7632b96750f admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.234676 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0ca7a-dfbd-4f90-89b6-c7632b96750f admin admin] PATH_INFO: `/v3/projects/d1d6d3a02e4f48109ca5b53fb6360f8b/users/1df50ddc693d4e07982ad570640f5320/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.249473 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0ca7a-dfbd-4f90-89b6-c7632b96750f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d6d3a02e4f48109ca5b53fb6360f8b, user_id=1df50ddc693d4e07982ad570640f5320, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.252138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0ca7a-dfbd-4f90-89b6-c7632b96750f admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.265044 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1399/2832] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:26 2022] PUT /identity/v3/projects/d1d6d3a02e4f48109ca5b53fb6360f8b/users/1df50ddc693d4e07982ad570640f5320/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:26.276094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c973d0-c191-45a4-8440-3308ef6dc395 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.276358 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c973d0-c191-45a4-8440-3308ef6dc395 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.276640 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c973d0-c191-45a4-8440-3308ef6dc395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.303112 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-77c973d0-c191-45a4-8440-3308ef6dc395 None None] MFA Rules not processed for user `1df50ddc693d4e07982ad570640f5320`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:26.304870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-77c973d0-c191-45a4-8440-3308ef6dc395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:26.368623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1434/2833] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:26.373178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0ca7a-dfbd-4f90-89b6-c7632b96750f admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.433866 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0ca7a-dfbd-4f90-89b6-c7632b96750f admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.438469 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4d2e2-5de9-4f4e-9acc-abbf9661c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.439114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4d2e2-5de9-4f4e-9acc-abbf9661c410 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.439395 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4d2e2-5de9-4f4e-9acc-abbf9661c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.439702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4d2e2-5de9-4f4e-9acc-abbf9661c410 admin admin] PATH_INFO: `/v3/projects` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.440400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4d2e2-5de9-4f4e-9acc-abbf9661c410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.442283 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4d2e2-5de9-4f4e-9acc-abbf9661c410 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.467078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1400/2834] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:37:26 2022] POST /identity/v3/projects => generated 388 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:26.471217 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c973d0-c191-45a4-8440-3308ef6dc395 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.482962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c973d0-c191-45a4-8440-3308ef6dc395 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.507935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:26.542568 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67f9be-b21f-4a81-b310-751d6951ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.543164 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67f9be-b21f-4a81-b310-751d6951ae25 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.543450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67f9be-b21f-4a81-b310-751d6951ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.543772 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67f9be-b21f-4a81-b310-751d6951ae25 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.544465 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67f9be-b21f-4a81-b310-751d6951ae25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.546404 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67f9be-b21f-4a81-b310-751d6951ae25 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.565745 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1435/2835] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:37:26 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:37:26.569874 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4d2e2-5de9-4f4e-9acc-abbf9661c410 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.580164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4d2e2-5de9-4f4e-9acc-abbf9661c410 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.584846 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70811c-248c-425b-902d-fcff80592a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.586007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70811c-248c-425b-902d-fcff80592a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.586289 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70811c-248c-425b-902d-fcff80592a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.586562 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70811c-248c-425b-902d-fcff80592a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.587279 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70811c-248c-425b-902d-fcff80592a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.588910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70811c-248c-425b-902d-fcff80592a3e admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.599306 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1401/2836] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:26 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:26.604126 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67f9be-b21f-4a81-b310-751d6951ae25 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.614662 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67f9be-b21f-4a81-b310-751d6951ae25 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.619899 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18719874-7396-4feb-ae81-67c7bc190453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.620807 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18719874-7396-4feb-ae81-67c7bc190453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.621094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18719874-7396-4feb-ae81-67c7bc190453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.621371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18719874-7396-4feb-ae81-67c7bc190453 admin admin] PATH_INFO: `/v3/projects/b179875f171b40479ab75c8bfd00e7bb/users/7c63966e69854e40b1643a2ee02415f4/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.636726 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18719874-7396-4feb-ae81-67c7bc190453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b179875f171b40479ab75c8bfd00e7bb, user_id=7c63966e69854e40b1643a2ee02415f4, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.639430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18719874-7396-4feb-ae81-67c7bc190453 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.653661 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1436/2837] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:26 2022] PUT /identity/v3/projects/b179875f171b40479ab75c8bfd00e7bb/users/7c63966e69854e40b1643a2ee02415f4/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:26.657621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70811c-248c-425b-902d-fcff80592a3e admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.667637 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70811c-248c-425b-902d-fcff80592a3e admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.722443 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d87928-bfb5-442f-9e48-46a9236383ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.723099 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d87928-bfb5-442f-9e48-46a9236383ae admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.723378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d87928-bfb5-442f-9e48-46a9236383ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.723686 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d87928-bfb5-442f-9e48-46a9236383ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.724541 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d87928-bfb5-442f-9e48-46a9236383ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.726246 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d87928-bfb5-442f-9e48-46a9236383ae admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.736557 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1402/2838] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:26 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:26.740634 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18719874-7396-4feb-ae81-67c7bc190453 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.750743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18719874-7396-4feb-ae81-67c7bc190453 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.755313 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1fc4-fe80-441d-8768-b16e2c9a691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.756204 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1fc4-fe80-441d-8768-b16e2c9a691d admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.756483 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1fc4-fe80-441d-8768-b16e2c9a691d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.756758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1fc4-fe80-441d-8768-b16e2c9a691d admin admin] PATH_INFO: `/v3/projects/b179875f171b40479ab75c8bfd00e7bb/users/7c63966e69854e40b1643a2ee02415f4/roles/f87e080ffaf045a5a133bedb12eb53cd` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.759223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e1fc4-fe80-441d-8768-b16e2c9a691d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b179875f171b40479ab75c8bfd00e7bb, user_id=7c63966e69854e40b1643a2ee02415f4, role_id=f87e080ffaf045a5a133bedb12eb53cd)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.762626 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e1fc4-fe80-441d-8768-b16e2c9a691d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.774111 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1437/2839] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:26 2022] PUT /identity/v3/projects/b179875f171b40479ab75c8bfd00e7bb/users/7c63966e69854e40b1643a2ee02415f4/roles/f87e080ffaf045a5a133bedb12eb53cd => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:26.784661 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375a11-416f-4a72-aa3a-71d47c2f0c27 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.785190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375a11-416f-4a72-aa3a-71d47c2f0c27 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.785190 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375a11-416f-4a72-aa3a-71d47c2f0c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.792021 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:26.812606 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-5d375a11-416f-4a72-aa3a-71d47c2f0c27 None None] MFA Rules not processed for user `7c63966e69854e40b1643a2ee02415f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:26.813744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-5d375a11-416f-4a72-aa3a-71d47c2f0c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:26.887487 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1403/2840] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:26.897983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1fc4-fe80-441d-8768-b16e2c9a691d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:26.900321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-859e1fc4-fe80-441d-8768-b16e2c9a691d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:26.957302 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1fc4-fe80-441d-8768-b16e2c9a691d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:26.961688 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9c159-1f07-480c-b4f4-b6538b6cbdb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:26.962318 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c159-1f07-480c-b4f4-b6538b6cbdb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:26.962599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c159-1f07-480c-b4f4-b6538b6cbdb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:26.962870 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c159-1f07-480c-b4f4-b6538b6cbdb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:26.972079 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9c159-1f07-480c-b4f4-b6538b6cbdb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:26.973502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9c159-1f07-480c-b4f4-b6538b6cbdb2 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:26.983095 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1438/2841] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:27.528757 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d375a11-416f-4a72-aa3a-71d47c2f0c27 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:27.589697 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d375a11-416f-4a72-aa3a-71d47c2f0c27 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:27.594253 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:27.595117 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:27.595400 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:27.595713 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] PATH_INFO: `/v3/users/1df50ddc693d4e07982ad570640f5320` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:27.596891 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df50ddc693d4e07982ad570640f5320)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:27.598892 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:27.643574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df50ddc693d4e07982ad570640f5320'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:27.644244 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df50ddc693d4e07982ad570640f5320'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:27.656592 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df50ddc693d4e07982ad570640f5320'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:27.663241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df50ddc693d4e07982ad570640f5320'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:27.663967 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df50ddc693d4e07982ad570640f5320'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:27.676338 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1404/2842] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:37:27 2022] DELETE /identity/v3/users/1df50ddc693d4e07982ad570640f5320 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:27.680866 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0cf5d-2081-4ded-b087-c243e94af5c7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:27.681231 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0cf5d-2081-4ded-b087-c243e94af5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:27.681600 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0cf5d-2081-4ded-b087-c243e94af5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:27.699751 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f6b0cf5d-2081-4ded-b087-c243e94af5c7 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:27.700956 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f6b0cf5d-2081-4ded-b087-c243e94af5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:27.760813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1439/2843] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:27.770460 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:27.771909 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:27.783371 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:27.831826 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d25193-d4ad-4592-b33f-59cddce07f43 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:27.835512 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf27a3-fb74-43cd-9a6b-ed9d4e20017c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:27.836185 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf27a3-fb74-43cd-9a6b-ed9d4e20017c service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:27.836471 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf27a3-fb74-43cd-9a6b-ed9d4e20017c service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:27.836752 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf27a3-fb74-43cd-9a6b-ed9d4e20017c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:27.846300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf27a3-fb74-43cd-9a6b-ed9d4e20017c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:27.847825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf27a3-fb74-43cd-9a6b-ed9d4e20017c service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:27.857798 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1405/2844] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:28.121757 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0cf5d-2081-4ded-b087-c243e94af5c7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:28.123202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f6b0cf5d-2081-4ded-b087-c243e94af5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:28.135929 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0cf5d-2081-4ded-b087-c243e94af5c7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:28.140775 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:28.141627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:28.141905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:28.142178 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] PATH_INFO: `/v3/projects/d1d6d3a02e4f48109ca5b53fb6360f8b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:28.143371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d6d3a02e4f48109ca5b53fb6360f8b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:28.145435 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:28.168501 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:28.194735 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d6d3a02e4f48109ca5b53fb6360f8b', 'request_id': 'req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.200927 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d6d3a02e4f48109ca5b53fb6360f8b', 'request_id': 'req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.209001 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d6d3a02e4f48109ca5b53fb6360f8b', 'request_id': 'req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.220380 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] The token cache is being invalidate because project d1d6d3a02e4f48109ca5b53fb6360f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:28.220697 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.221355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.222906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1440/2845] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:28 2022] DELETE /identity/v3/projects/d1d6d3a02e4f48109ca5b53fb6360f8b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:28.227468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf27a3-fb74-43cd-9a6b-ed9d4e20017c service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:28.237607 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf27a3-fb74-43cd-9a6b-ed9d4e20017c service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:28.296836 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:28.297723 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:28.298003 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:28.298274 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] PATH_INFO: `/v3/users/7c63966e69854e40b1643a2ee02415f4` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:28.299438 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c63966e69854e40b1643a2ee02415f4)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:28.301415 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:28.349576 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c63966e69854e40b1643a2ee02415f4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.352784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c63966e69854e40b1643a2ee02415f4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.373499 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c63966e69854e40b1643a2ee02415f4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.380559 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c63966e69854e40b1643a2ee02415f4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.381221 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c7a56834-a0da-42de-a785-0dc3f9afc6be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c63966e69854e40b1643a2ee02415f4'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.393543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1406/2846] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:37:28 2022] DELETE /identity/v3/users/7c63966e69854e40b1643a2ee02415f4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:28.660385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:28.661855 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:28.675470 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8e0b-cf9a-4cd9-b5f1-bd105b29d1c4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:28.733856 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:28.734720 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:28.735005 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:28.735283 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] PATH_INFO: `/v3/projects/b179875f171b40479ab75c8bfd00e7bb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:28.736515 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] RBAC: Authorizing `identity:delete_project(project_id=b179875f171b40479ab75c8bfd00e7bb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:28.738425 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:28.784412 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b179875f171b40479ab75c8bfd00e7bb', 'request_id': 'req-a472bf8a-cf54-4014-ae1d-c227c23faded'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.791202 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b179875f171b40479ab75c8bfd00e7bb', 'request_id': 'req-a472bf8a-cf54-4014-ae1d-c227c23faded'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.798497 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b179875f171b40479ab75c8bfd00e7bb', 'request_id': 'req-a472bf8a-cf54-4014-ae1d-c227c23faded'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.808916 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] The token cache is being invalidate because project b179875f171b40479ab75c8bfd00e7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:28.809206 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.809840 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a472bf8a-cf54-4014-ae1d-c227c23faded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:28.811379 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1441/2847] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:28 2022] DELETE /identity/v3/projects/b179875f171b40479ab75c8bfd00e7bb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:28.816384 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0475a-bbdd-482b-ab7a-eb3062d5ec6c None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:28.816678 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0475a-bbdd-482b-ab7a-eb3062d5ec6c None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:28.816958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0475a-bbdd-482b-ab7a-eb3062d5ec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:28.834248 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-45a0475a-bbdd-482b-ab7a-eb3062d5ec6c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:28.835452 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-45a0475a-bbdd-482b-ab7a-eb3062d5ec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:28.863013 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:28.897051 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1407/2848] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 16:37:28.905384 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e02251-2531-4a7f-83b4-c0e1cf29931c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:28.905642 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e02251-2531-4a7f-83b4-c0e1cf29931c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:28.905926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e02251-2531-4a7f-83b4-c0e1cf29931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:28.924035 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-79e02251-2531-4a7f-83b4-c0e1cf29931c None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:28.925266 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-79e02251-2531-4a7f-83b4-c0e1cf29931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:28.933133 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1442/2849] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:28.937335 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0475a-bbdd-482b-ab7a-eb3062d5ec6c None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:28.947702 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0475a-bbdd-482b-ab7a-eb3062d5ec6c None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:28.952260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333783-345a-445c-9e17-bf82b8afaa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:28.952901 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333783-345a-445c-9e17-bf82b8afaa56 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:28.953179 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333783-345a-445c-9e17-bf82b8afaa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:28.953449 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333783-345a-445c-9e17-bf82b8afaa56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:28.954195 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333783-345a-445c-9e17-bf82b8afaa56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:37:28.954500 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333783-345a-445c-9e17-bf82b8afaa56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:28.956112 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333783-345a-445c-9e17-bf82b8afaa56 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:28.968177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1408/2850] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:37:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:37:28.972493 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e02251-2531-4a7f-83b4-c0e1cf29931c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:28.982558 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e02251-2531-4a7f-83b4-c0e1cf29931c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:28.987321 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88221677-0ae2-4a8c-82a8-5f8269756ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:28.988004 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88221677-0ae2-4a8c-82a8-5f8269756ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:28.988288 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88221677-0ae2-4a8c-82a8-5f8269756ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:28.988563 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88221677-0ae2-4a8c-82a8-5f8269756ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:28.989255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88221677-0ae2-4a8c-82a8-5f8269756ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:28.991141 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88221677-0ae2-4a8c-82a8-5f8269756ad7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:29.017548 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1443/2851] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:37:28 2022] POST /identity/v3/projects => generated 372 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:37:29.021784 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333783-345a-445c-9e17-bf82b8afaa56 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:29.032542 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333783-345a-445c-9e17-bf82b8afaa56 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:29.092078 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6d491-220c-4bc8-b9fe-65eebacb3eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:29.092744 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6d491-220c-4bc8-b9fe-65eebacb3eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:29.093032 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6d491-220c-4bc8-b9fe-65eebacb3eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:29.093312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6d491-220c-4bc8-b9fe-65eebacb3eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:29.094010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6d491-220c-4bc8-b9fe-65eebacb3eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:29.095999 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6d491-220c-4bc8-b9fe-65eebacb3eb1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:29.117462 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1409/2852] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:37:29 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:29.121739 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88221677-0ae2-4a8c-82a8-5f8269756ad7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:29.132181 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88221677-0ae2-4a8c-82a8-5f8269756ad7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:29.136844 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1879b-6ba0-4771-ab89-e6ed9f2e0d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:29.137488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1879b-6ba0-4771-ab89-e6ed9f2e0d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:29.137766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1879b-6ba0-4771-ab89-e6ed9f2e0d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:29.138036 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1879b-6ba0-4771-ab89-e6ed9f2e0d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:29.138758 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1879b-6ba0-4771-ab89-e6ed9f2e0d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:29.140378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1879b-6ba0-4771-ab89-e6ed9f2e0d63 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:29.142639 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:29.152223 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1444/2853] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:29 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:29.155987 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6d491-220c-4bc8-b9fe-65eebacb3eb1 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:29.166769 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6d491-220c-4bc8-b9fe-65eebacb3eb1 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:29.171633 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b7bf5-6175-4546-8699-d1b835e91bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:29.172296 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7bf5-6175-4546-8699-d1b835e91bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:29.172580 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7bf5-6175-4546-8699-d1b835e91bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:29.172884 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7bf5-6175-4546-8699-d1b835e91bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:29.173612 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b7bf5-6175-4546-8699-d1b835e91bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:29.175212 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b7bf5-6175-4546-8699-d1b835e91bb5 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:29.186047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1410/2854] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:29 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:29.190311 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1879b-6ba0-4771-ab89-e6ed9f2e0d63 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:29.200407 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1879b-6ba0-4771-ab89-e6ed9f2e0d63 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:29.204961 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470004a-06bc-4fc0-9b55-acb652718c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:29.205831 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470004a-06bc-4fc0-9b55-acb652718c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:29.206109 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470004a-06bc-4fc0-9b55-acb652718c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:29.206385 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470004a-06bc-4fc0-9b55-acb652718c72 admin admin] PATH_INFO: `/v3/projects/639d3651559842d28bf4d6f7eb121286/users/bf0db95e8a644c3f818d85ce5c7217ac/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:29.221740 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470004a-06bc-4fc0-9b55-acb652718c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639d3651559842d28bf4d6f7eb121286, user_id=bf0db95e8a644c3f818d85ce5c7217ac, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:29.224430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470004a-06bc-4fc0-9b55-acb652718c72 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:29.238653 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1445/2855] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:29 2022] PUT /identity/v3/projects/639d3651559842d28bf4d6f7eb121286/users/bf0db95e8a644c3f818d85ce5c7217ac/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:29.249627 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7c456-7df8-403b-a423-cbedeebbfc2b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:29.249926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7c456-7df8-403b-a423-cbedeebbfc2b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:29.250215 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7c456-7df8-403b-a423-cbedeebbfc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:29.276771 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-61a7c456-7df8-403b-a423-cbedeebbfc2b None None] MFA Rules not processed for user `bf0db95e8a644c3f818d85ce5c7217ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:29.277976 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-61a7c456-7df8-403b-a423-cbedeebbfc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:29.341397 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1411/2856] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:29.353183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470004a-06bc-4fc0-9b55-acb652718c72 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:29.355201 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b470004a-06bc-4fc0-9b55-acb652718c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:29.409551 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470004a-06bc-4fc0-9b55-acb652718c72 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:29.413075 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213460f1-8bb7-486e-9d12-04bb2b472c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:29.413743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213460f1-8bb7-486e-9d12-04bb2b472c06 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:29.414523 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213460f1-8bb7-486e-9d12-04bb2b472c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:29.414796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213460f1-8bb7-486e-9d12-04bb2b472c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:29.423064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213460f1-8bb7-486e-9d12-04bb2b472c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:29.424508 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213460f1-8bb7-486e-9d12-04bb2b472c06 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:29.433102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1446/2857] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:29.452069 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7c456-7df8-403b-a423-cbedeebbfc2b None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:29.483104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:29.516546 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7c456-7df8-403b-a423-cbedeebbfc2b None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:29.523668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:29.523668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:29.523668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:29.523668 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] PATH_INFO: `/v3/users/bf0db95e8a644c3f818d85ce5c7217ac` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:29.525518 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf0db95e8a644c3f818d85ce5c7217ac)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:29.526300 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:29.572897 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf0db95e8a644c3f818d85ce5c7217ac'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:29.573567 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf0db95e8a644c3f818d85ce5c7217ac'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:29.585332 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf0db95e8a644c3f818d85ce5c7217ac'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:29.592646 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf0db95e8a644c3f818d85ce5c7217ac'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:29.593309 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf0db95e8a644c3f818d85ce5c7217ac'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:29.607245 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1412/2858] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:37:29 2022] DELETE /identity/v3/users/bf0db95e8a644c3f818d85ce5c7217ac => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:29.611810 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e124dff-ead5-4995-a0ef-be4ebc65c767 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:29.612097 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e124dff-ead5-4995-a0ef-be4ebc65c767 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:29.612378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e124dff-ead5-4995-a0ef-be4ebc65c767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:29.629357 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2e124dff-ead5-4995-a0ef-be4ebc65c767 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:29.630546 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2e124dff-ead5-4995-a0ef-be4ebc65c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:29.689155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1447/2859] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:29.699539 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:29.700998 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:29.768881 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c02127-947f-4bad-aba0-6db226446d5c admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:29.772792 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147314e5-2d6a-4a85-bd60-24d79a696a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:29.774000 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147314e5-2d6a-4a85-bd60-24d79a696a5d service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:29.774284 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147314e5-2d6a-4a85-bd60-24d79a696a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:29.774560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147314e5-2d6a-4a85-bd60-24d79a696a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:29.783981 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147314e5-2d6a-4a85-bd60-24d79a696a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:29.785410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147314e5-2d6a-4a85-bd60-24d79a696a5d service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:29.794811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1413/2860] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:30.073161 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e124dff-ead5-4995-a0ef-be4ebc65c767 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:30.074595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2e124dff-ead5-4995-a0ef-be4ebc65c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:30.087381 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e124dff-ead5-4995-a0ef-be4ebc65c767 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:30.092468 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:30.093329 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.093652 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.093962 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] PATH_INFO: `/v3/projects/639d3651559842d28bf4d6f7eb121286` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.095240 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] RBAC: Authorizing `identity:delete_project(project_id=639d3651559842d28bf4d6f7eb121286)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:30.097294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:30.148760 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639d3651559842d28bf4d6f7eb121286', 'request_id': 'req-7f1ba699-8f13-40cc-9e83-891c8d7c98df'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:30.155488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639d3651559842d28bf4d6f7eb121286', 'request_id': 'req-7f1ba699-8f13-40cc-9e83-891c8d7c98df'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:30.164094 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639d3651559842d28bf4d6f7eb121286', 'request_id': 'req-7f1ba699-8f13-40cc-9e83-891c8d7c98df'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:30.171897 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:30.176678 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] The token cache is being invalidate because project 639d3651559842d28bf4d6f7eb121286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:30.177261 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:30.177983 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7f1ba699-8f13-40cc-9e83-891c8d7c98df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:30.180512 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1448/2861] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:30 2022] DELETE /identity/v3/projects/639d3651559842d28bf4d6f7eb121286 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:30.185378 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb55f20-3715-4325-9950-b14ef5c686cf None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.185910 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb55f20-3715-4325-9950-b14ef5c686cf None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.186064 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb55f20-3715-4325-9950-b14ef5c686cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.204754 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-fdb55f20-3715-4325-9950-b14ef5c686cf None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:30.205914 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fdb55f20-3715-4325-9950-b14ef5c686cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:30.252360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:30.269954 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1414/2862] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:30.279008 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61578e-4f97-42f0-ae85-7407c8cf4977 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.279366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61578e-4f97-42f0-ae85-7407c8cf4977 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.279692 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61578e-4f97-42f0-ae85-7407c8cf4977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.298491 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-eb61578e-4f97-42f0-ae85-7407c8cf4977 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:30.299748 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eb61578e-4f97-42f0-ae85-7407c8cf4977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:30.308323 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1449/2863] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:30.312669 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb55f20-3715-4325-9950-b14ef5c686cf None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:30.323191 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb55f20-3715-4325-9950-b14ef5c686cf None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:30.328164 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e8fad-239b-4dea-9c3b-5c1d0a438b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:30.328811 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e8fad-239b-4dea-9c3b-5c1d0a438b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.329089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e8fad-239b-4dea-9c3b-5c1d0a438b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.329365 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e8fad-239b-4dea-9c3b-5c1d0a438b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.330076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e8fad-239b-4dea-9c3b-5c1d0a438b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:37:30.330383 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e8fad-239b-4dea-9c3b-5c1d0a438b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:30.332008 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e8fad-239b-4dea-9c3b-5c1d0a438b37 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:30.343527 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1415/2864] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:37:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 16:37:30.348098 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61578e-4f97-42f0-ae85-7407c8cf4977 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:30.357868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61578e-4f97-42f0-ae85-7407c8cf4977 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:30.362569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafef47-08a9-42e3-bab8-608a8aae6858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:30.363222 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafef47-08a9-42e3-bab8-608a8aae6858 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.363505 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafef47-08a9-42e3-bab8-608a8aae6858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.363816 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafef47-08a9-42e3-bab8-608a8aae6858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.364542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafef47-08a9-42e3-bab8-608a8aae6858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:30.366447 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafef47-08a9-42e3-bab8-608a8aae6858 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:30.392871 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1450/2865] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:37:30 2022] POST /identity/v3/projects => generated 378 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:30.397084 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e8fad-239b-4dea-9c3b-5c1d0a438b37 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:30.407269 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e8fad-239b-4dea-9c3b-5c1d0a438b37 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:30.462743 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a0671-1f5c-483e-87e8-99774aa778db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:30.463385 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a0671-1f5c-483e-87e8-99774aa778db admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.463636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a0671-1f5c-483e-87e8-99774aa778db admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.463923 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a0671-1f5c-483e-87e8-99774aa778db admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.464619 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a0671-1f5c-483e-87e8-99774aa778db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:30.466581 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a0671-1f5c-483e-87e8-99774aa778db admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:30.487412 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1416/2866] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:37:30 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 16:37:30.491617 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafef47-08a9-42e3-bab8-608a8aae6858 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:30.502366 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafef47-08a9-42e3-bab8-608a8aae6858 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:30.506905 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e556675-bc11-48bc-8203-84dd8912926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:30.507610 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e556675-bc11-48bc-8203-84dd8912926b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.507903 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e556675-bc11-48bc-8203-84dd8912926b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.508183 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e556675-bc11-48bc-8203-84dd8912926b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.508917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e556675-bc11-48bc-8203-84dd8912926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:30.510500 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e556675-bc11-48bc-8203-84dd8912926b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:30.520906 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1451/2867] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:30 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:30.524962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a0671-1f5c-483e-87e8-99774aa778db admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:30.535007 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a0671-1f5c-483e-87e8-99774aa778db admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:30.540317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b11feb-9866-49d6-bafc-9e827fa9f9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:30.540975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b11feb-9866-49d6-bafc-9e827fa9f9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.541260 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b11feb-9866-49d6-bafc-9e827fa9f9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.541566 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b11feb-9866-49d6-bafc-9e827fa9f9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.542290 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b11feb-9866-49d6-bafc-9e827fa9f9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:30.543934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b11feb-9866-49d6-bafc-9e827fa9f9b1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:30.554086 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1417/2868] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:30 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:30.558737 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e556675-bc11-48bc-8203-84dd8912926b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:30.568664 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e556675-bc11-48bc-8203-84dd8912926b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:30.573410 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cc702-6a24-4386-9bf8-de34844b94a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:30.574305 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cc702-6a24-4386-9bf8-de34844b94a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.574595 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cc702-6a24-4386-9bf8-de34844b94a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.574868 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cc702-6a24-4386-9bf8-de34844b94a8 admin admin] PATH_INFO: `/v3/projects/d16df996e6284085a0703e9c59a72187/users/2a92a7b9c09547babdb281bee3b055ae/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.589064 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cc702-6a24-4386-9bf8-de34844b94a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16df996e6284085a0703e9c59a72187, user_id=2a92a7b9c09547babdb281bee3b055ae, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:30.591729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cc702-6a24-4386-9bf8-de34844b94a8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:30.605375 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1452/2869] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:30 2022] PUT /identity/v3/projects/d16df996e6284085a0703e9c59a72187/users/2a92a7b9c09547babdb281bee3b055ae/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:30.615872 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba56a3-b3f0-4197-8e20-bbc70678d8a8 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.616165 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba56a3-b3f0-4197-8e20-bbc70678d8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.616445 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba56a3-b3f0-4197-8e20-bbc70678d8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.643036 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-50ba56a3-b3f0-4197-8e20-bbc70678d8a8 None None] MFA Rules not processed for user `2a92a7b9c09547babdb281bee3b055ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:30.644291 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-50ba56a3-b3f0-4197-8e20-bbc70678d8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:30.709508 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1418/2870] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:30.720602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cc702-6a24-4386-9bf8-de34844b94a8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:30.722959 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f00cc702-6a24-4386-9bf8-de34844b94a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:30.780717 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cc702-6a24-4386-9bf8-de34844b94a8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:30.784416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aafbdb-0fb5-4db2-9228-565179ddc0a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:30.785060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aafbdb-0fb5-4db2-9228-565179ddc0a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:30.785344 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aafbdb-0fb5-4db2-9228-565179ddc0a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:30.785622 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aafbdb-0fb5-4db2-9228-565179ddc0a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:30.795306 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aafbdb-0fb5-4db2-9228-565179ddc0a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:30.796766 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aafbdb-0fb5-4db2-9228-565179ddc0a1 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:30.805608 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1453/2871] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:36.162950 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba56a3-b3f0-4197-8e20-bbc70678d8a8 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:36.165034 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-50ba56a3-b3f0-4197-8e20-bbc70678d8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:36.218374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:36.234299 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba56a3-b3f0-4197-8e20-bbc70678d8a8 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:36.238485 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b21a8-68b7-4cd5-97e3-7c1444c9efa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:36.239208 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b21a8-68b7-4cd5-97e3-7c1444c9efa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:36.239588 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b21a8-68b7-4cd5-97e3-7c1444c9efa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:36.239962 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b21a8-68b7-4cd5-97e3-7c1444c9efa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:36.242932 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-b65b21a8-68b7-4cd5-97e3-7c1444c9efa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:36.320367 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b21a8-68b7-4cd5-97e3-7c1444c9efa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:36.321815 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b21a8-68b7-4cd5-97e3-7c1444c9efa6 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:36.334067 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1419/2872] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:37.622416 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aafbdb-0fb5-4db2-9228-565179ddc0a1 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:37.623940 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-35aafbdb-0fb5-4db2-9228-565179ddc0a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:37.635738 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aafbdb-0fb5-4db2-9228-565179ddc0a1 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:37.639671 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7583c-aa53-4584-aff2-3ba0bf4e7b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:37.640296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7583c-aa53-4584-aff2-3ba0bf4e7b60 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:37.640569 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7583c-aa53-4584-aff2-3ba0bf4e7b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:37.640837 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7583c-aa53-4584-aff2-3ba0bf4e7b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:37.642534 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c9d7583c-aa53-4584-aff2-3ba0bf4e7b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:37.656067 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7583c-aa53-4584-aff2-3ba0bf4e7b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:37.657464 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7583c-aa53-4584-aff2-3ba0bf4e7b60 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:37.668724 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1454/2873] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:42.150409 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b21a8-68b7-4cd5-97e3-7c1444c9efa6 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:42.216490 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b21a8-68b7-4cd5-97e3-7c1444c9efa6 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:42.221468 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:42.222356 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:42.222645 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:42.222924 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] PATH_INFO: `/v3/users/2a92a7b9c09547babdb281bee3b055ae` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:42.224203 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a92a7b9c09547babdb281bee3b055ae)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:42.226146 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:42.272033 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a92a7b9c09547babdb281bee3b055ae'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.272692 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a92a7b9c09547babdb281bee3b055ae'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.284926 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a92a7b9c09547babdb281bee3b055ae'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.292247 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a92a7b9c09547babdb281bee3b055ae'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.292900 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a92a7b9c09547babdb281bee3b055ae'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.305765 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1420/2874] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:37:42 2022] DELETE /identity/v3/users/2a92a7b9c09547babdb281bee3b055ae => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:42.310294 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebcb1e-70be-44ad-85b7-5007354e017d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:42.310808 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebcb1e-70be-44ad-85b7-5007354e017d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:42.310914 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebcb1e-70be-44ad-85b7-5007354e017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:42.327636 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-62ebcb1e-70be-44ad-85b7-5007354e017d None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:42.328804 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-62ebcb1e-70be-44ad-85b7-5007354e017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:42.393736 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1455/2875] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:42.403874 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:42.405315 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:42.411854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:42.466747 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a6387-e47c-4002-b281-d26cc4360986 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:42.470540 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9e3e4-9282-4ef8-b40f-06fa10f75a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:42.471192 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9e3e4-9282-4ef8-b40f-06fa10f75a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:42.471475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9e3e4-9282-4ef8-b40f-06fa10f75a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:42.471793 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9e3e4-9282-4ef8-b40f-06fa10f75a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:42.482125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9e3e4-9282-4ef8-b40f-06fa10f75a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:42.483659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9e3e4-9282-4ef8-b40f-06fa10f75a19 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:42.493614 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1421/2876] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 16:37:42.763520 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebcb1e-70be-44ad-85b7-5007354e017d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:42.764975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-62ebcb1e-70be-44ad-85b7-5007354e017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:42.778389 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebcb1e-70be-44ad-85b7-5007354e017d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:42.783333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:42.784237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:42.784651 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:42.784935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] PATH_INFO: `/v3/projects/d16df996e6284085a0703e9c59a72187` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:42.786130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16df996e6284085a0703e9c59a72187)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:42.788065 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:42.813131 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:42.837355 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16df996e6284085a0703e9c59a72187', 'request_id': 'req-57f9b10e-5386-47fd-8e7e-a4b681139a1a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.843296 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16df996e6284085a0703e9c59a72187', 'request_id': 'req-57f9b10e-5386-47fd-8e7e-a4b681139a1a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.850437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16df996e6284085a0703e9c59a72187', 'request_id': 'req-57f9b10e-5386-47fd-8e7e-a4b681139a1a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.861444 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] The token cache is being invalidate because project d16df996e6284085a0703e9c59a72187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:37:42.861729 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.862356 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-57f9b10e-5386-47fd-8e7e-a4b681139a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:37:42.863987 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1456/2877] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:37:42 2022] DELETE /identity/v3/projects/d16df996e6284085a0703e9c59a72187 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:42.869334 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8579e-a208-433b-9456-9dca99090178 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:42.869620 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8579e-a208-433b-9456-9dca99090178 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:42.869895 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8579e-a208-433b-9456-9dca99090178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:42.887972 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-f3a8579e-a208-433b-9456-9dca99090178 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:42.889125 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-f3a8579e-a208-433b-9456-9dca99090178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:42.947868 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1422/2878] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:42.956336 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab9ac-9ad0-4f49-b79d-05d94f227676 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:42.956655 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab9ac-9ad0-4f49-b79d-05d94f227676 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:42.956938 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab9ac-9ad0-4f49-b79d-05d94f227676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:42.974973 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-602ab9ac-9ad0-4f49-b79d-05d94f227676 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:42.976188 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-602ab9ac-9ad0-4f49-b79d-05d94f227676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:42.984298 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1457/2879] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:42.988464 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8579e-a208-433b-9456-9dca99090178 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:42.998823 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8579e-a208-433b-9456-9dca99090178 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:43.003404 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743aa11-ac04-4060-b22c-fe5b52eda4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:43.004079 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743aa11-ac04-4060-b22c-fe5b52eda4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:43.004360 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743aa11-ac04-4060-b22c-fe5b52eda4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:43.004636 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743aa11-ac04-4060-b22c-fe5b52eda4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:43.005439 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743aa11-ac04-4060-b22c-fe5b52eda4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80221) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 16:37:43.005774 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743aa11-ac04-4060-b22c-fe5b52eda4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:43.007370 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743aa11-ac04-4060-b22c-fe5b52eda4b1 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:43.019441 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1423/2880] 10.222.0.112 () {58 vars in 1157 bytes} [Fri Jun 3 16:37:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 16:37:43.023718 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ab9ac-9ad0-4f49-b79d-05d94f227676 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:43.033437 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ab9ac-9ad0-4f49-b79d-05d94f227676 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:43.039080 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effb037-ed6e-4ef1-8279-ee00d9684ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:43.039821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effb037-ed6e-4ef1-8279-ee00d9684ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:43.039998 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effb037-ed6e-4ef1-8279-ee00d9684ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:43.040413 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effb037-ed6e-4ef1-8279-ee00d9684ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:43.040996 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effb037-ed6e-4ef1-8279-ee00d9684ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:43.042931 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effb037-ed6e-4ef1-8279-ee00d9684ae6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:43.071326 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1458/2881] 10.222.0.112 () {60 vars in 1157 bytes} [Fri Jun 3 16:37:43 2022] POST /identity/v3/projects => generated 374 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:43.075816 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743aa11-ac04-4060-b22c-fe5b52eda4b1 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:43.087342 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743aa11-ac04-4060-b22c-fe5b52eda4b1 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:43.144955 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a235-4270-4215-8d1f-39f579dcdc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:43.145628 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a235-4270-4215-8d1f-39f579dcdc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:43.145915 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a235-4270-4215-8d1f-39f579dcdc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:43.146196 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a235-4270-4215-8d1f-39f579dcdc61 admin admin] PATH_INFO: `/v3/users` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:43.146904 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441a235-4270-4215-8d1f-39f579dcdc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:43.148908 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441a235-4270-4215-8d1f-39f579dcdc61 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:43.171012 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1424/2882] 10.222.0.112 () {60 vars in 1148 bytes} [Fri Jun 3 16:37:43 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 16:37:43.176882 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effb037-ed6e-4ef1-8279-ee00d9684ae6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:43.188193 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effb037-ed6e-4ef1-8279-ee00d9684ae6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:43.192863 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8da3-f578-4798-a41e-e7424b54c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:43.193510 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8da3-f578-4798-a41e-e7424b54c0df admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:43.193787 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8da3-f578-4798-a41e-e7424b54c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:43.194058 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f8da3-f578-4798-a41e-e7424b54c0df admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:43.194778 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f8da3-f578-4798-a41e-e7424b54c0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:43.196420 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f8da3-f578-4798-a41e-e7424b54c0df admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:43.206542 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1459/2883] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:43 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:43.210724 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a235-4270-4215-8d1f-39f579dcdc61 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:43.221374 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a235-4270-4215-8d1f-39f579dcdc61 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:43.226177 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bb08a-8ca7-4558-9282-af1baa97656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:43.227436 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb08a-8ca7-4558-9282-af1baa97656c admin admin] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:43.227762 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb08a-8ca7-4558-9282-af1baa97656c admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:43.228047 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bb08a-8ca7-4558-9282-af1baa97656c admin admin] PATH_INFO: `/v3/roles` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:43.228952 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bb08a-8ca7-4558-9282-af1baa97656c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:43.230710 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bb08a-8ca7-4558-9282-af1baa97656c admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:43.242963 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1425/2884] 10.222.0.112 () {58 vars in 1126 bytes} [Fri Jun 3 16:37:43 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 16:37:43.247226 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8da3-f578-4798-a41e-e7424b54c0df admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:43.257216 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f8da3-f578-4798-a41e-e7424b54c0df admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:43.261926 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972fa34-cc84-4b8a-8eb4-dfebd265d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:43.262795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972fa34-cc84-4b8a-8eb4-dfebd265d997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:43.263071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972fa34-cc84-4b8a-8eb4-dfebd265d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:43.263369 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972fa34-cc84-4b8a-8eb4-dfebd265d997 admin admin] PATH_INFO: `/v3/projects/f3ce985154f5419f9d41595733299955/users/8ebcbd45785049a69e3beb778b891fa6/roles/0048b2f4edbf4a69a99a3d1225c90e18` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:43.278795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972fa34-cc84-4b8a-8eb4-dfebd265d997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ce985154f5419f9d41595733299955, user_id=8ebcbd45785049a69e3beb778b891fa6, role_id=0048b2f4edbf4a69a99a3d1225c90e18)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:43.281495 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972fa34-cc84-4b8a-8eb4-dfebd265d997 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:43.296970 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1460/2885] 10.222.0.112 () {60 vars in 1487 bytes} [Fri Jun 3 16:37:43 2022] PUT /identity/v3/projects/f3ce985154f5419f9d41595733299955/users/8ebcbd45785049a69e3beb778b891fa6/roles/0048b2f4edbf4a69a99a3d1225c90e18 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:37:43.308753 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a3622-eaf9-40a2-9f1e-48483c1d3aa1 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:43.309048 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a3622-eaf9-40a2-9f1e-48483c1d3aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:43.309333 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a3622-eaf9-40a2-9f1e-48483c1d3aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:43.334122 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:43.337687 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3d0a3622-eaf9-40a2-9f1e-48483c1d3aa1 None None] MFA Rules not processed for user `8ebcbd45785049a69e3beb778b891fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:43.339916 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3d0a3622-eaf9-40a2-9f1e-48483c1d3aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:43.408186 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1426/2886] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:43.419142 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972fa34-cc84-4b8a-8eb4-dfebd265d997 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:43.421092 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d972fa34-cc84-4b8a-8eb4-dfebd265d997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:43.480631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972fa34-cc84-4b8a-8eb4-dfebd265d997 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:43.484480 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d4ee6-5464-4668-ac12-4859cd9ac4cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8571493023904002bd334e74441d134d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:43.485125 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d4ee6-5464-4668-ac12-4859cd9ac4cb service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:43.485411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d4ee6-5464-4668-ac12-4859cd9ac4cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:43.485686 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d4ee6-5464-4668-ac12-4859cd9ac4cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:43.495155 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d4ee6-5464-4668-ac12-4859cd9ac4cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:43.496641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d4ee6-5464-4668-ac12-4859cd9ac4cb service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:43.506025 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1461/2887] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:44.880010 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c04db-d9ec-4cca-bd94-8c4e8e09128b None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:44.880772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c04db-d9ec-4cca-bd94-8c4e8e09128b None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:44.880772 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c04db-d9ec-4cca-bd94-8c4e8e09128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:44.897885 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-ac0c04db-d9ec-4cca-bd94-8c4e8e09128b None None] MFA Rules not processed for user `8ebcbd45785049a69e3beb778b891fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:44.899101 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-ac0c04db-d9ec-4cca-bd94-8c4e8e09128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:44.906387 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1427/2888] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:47.084264 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d4ee6-5464-4668-ac12-4859cd9ac4cb service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:47.085795 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-036d4ee6-5464-4668-ac12-4859cd9ac4cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:47.141090 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:47.145191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d4ee6-5464-4668-ac12-4859cd9ac4cb service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:47.149920 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:47.150821 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:47.151148 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:47.151790 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:47.154200 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:47.164374 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:47.166304 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:47.174609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1462/2889] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:37:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:37:54.892475 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=29 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:57.170909 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:37:58.446818 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d1fc8-ca79-48d8-b860-90bb8cce0e5f None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:58.447394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d1fc8-ca79-48d8-b860-90bb8cce0e5f None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:58.447394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d1fc8-ca79-48d8-b860-90bb8cce0e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:58.465317 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-617d1fc8-ca79-48d8-b860-90bb8cce0e5f None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:58.466514 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-617d1fc8-ca79-48d8-b860-90bb8cce0e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:58.520729 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1428/2890] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:58.559981 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:58.561388 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:58.628841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55127a5-f00c-4e7b-a05f-b3e130a6e9cb service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:58.633794 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7229-69d2-4b19-aecd-5c2b164799b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:58.635054 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7229-69d2-4b19-aecd-5c2b164799b8 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:58.635333 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7229-69d2-4b19-aecd-5c2b164799b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:58.635631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7229-69d2-4b19-aecd-5c2b164799b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:58.643728 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba7229-69d2-4b19-aecd-5c2b164799b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:58.645293 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba7229-69d2-4b19-aecd-5c2b164799b8 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:58.653319 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1463/2891] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:37:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:37:59.145401 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cea77-3441-4352-b555-002af58ab879 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:59.145696 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cea77-3441-4352-b555-002af58ab879 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:59.145977 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cea77-3441-4352-b555-002af58ab879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:59.164853 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-1d0cea77-3441-4352-b555-002af58ab879 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:59.165985 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-1d0cea77-3441-4352-b555-002af58ab879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:59.173887 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1429/2892] 10.222.0.112 () {58 vars in 972 bytes} [Fri Jun 3 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:59.185641 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7229-69d2-4b19-aecd-5c2b164799b8 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:59.196172 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7229-69d2-4b19-aecd-5c2b164799b8 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:59.201599 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfda46-3fa8-420f-b45e-82c46665f98d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:59.202194 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfda46-3fa8-420f-b45e-82c46665f98d service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:59.202472 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfda46-3fa8-420f-b45e-82c46665f98d service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:59.202743 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfda46-3fa8-420f-b45e-82c46665f98d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:59.210797 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfda46-3fa8-420f-b45e-82c46665f98d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:59.213043 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfda46-3fa8-420f-b45e-82c46665f98d service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:59.221859 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1464/2893] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 16:37:59.409851 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd29f2-6e19-4eec-8bbd-f79c86d45484 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:59.410132 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd29f2-6e19-4eec-8bbd-f79c86d45484 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:59.410410 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd29f2-6e19-4eec-8bbd-f79c86d45484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:59.428138 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-91cd29f2-6e19-4eec-8bbd-f79c86d45484 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:59.429241 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-91cd29f2-6e19-4eec-8bbd-f79c86d45484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:59.436813 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1430/2894] 10.222.0.112 () {58 vars in 1014 bytes} [Fri Jun 3 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:59.449212 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfda46-3fa8-420f-b45e-82c46665f98d service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:59.460177 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfda46-3fa8-420f-b45e-82c46665f98d service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:59.465259 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d22f4-8104-40e6-bc67-739ecf058701 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:59.465917 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d22f4-8104-40e6-bc67-739ecf058701 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:59.466203 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d22f4-8104-40e6-bc67-739ecf058701 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:59.466479 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d22f4-8104-40e6-bc67-739ecf058701 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:59.474609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d22f4-8104-40e6-bc67-739ecf058701 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:59.476224 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d22f4-8104-40e6-bc67-739ecf058701 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:59.484543 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1465/2895] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:37:59.797428 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470b05-1da2-416d-b387-cd763e497871 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:59.797911 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470b05-1da2-416d-b387-cd763e497871 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:59.798115 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470b05-1da2-416d-b387-cd763e497871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:59.816529 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-28470b05-1da2-416d-b387-cd763e497871 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:37:59.817734 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-28470b05-1da2-416d-b387-cd763e497871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:37:59.824828 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1431/2896] 10.222.0.112 () {58 vars in 972 bytes} [Fri Jun 3 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:37:59.836676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d22f4-8104-40e6-bc67-739ecf058701 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:37:59.848102 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d22f4-8104-40e6-bc67-739ecf058701 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:37:59.853602 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb0201-6a7f-4ef9-a829-d1f4910bb2fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:37:59.854230 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb0201-6a7f-4ef9-a829-d1f4910bb2fa service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:37:59.854511 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb0201-6a7f-4ef9-a829-d1f4910bb2fa service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:37:59.854789 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb0201-6a7f-4ef9-a829-d1f4910bb2fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:37:59.863191 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb0201-6a7f-4ef9-a829-d1f4910bb2fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:37:59.864796 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb0201-6a7f-4ef9-a829-d1f4910bb2fa service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:37:59.873441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1466/2897] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 16:38:01.912623 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28470b05-1da2-416d-b387-cd763e497871 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:01.974579 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28470b05-1da2-416d-b387-cd763e497871 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:01.979511 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:01.980416 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:01.980979 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:01.981263 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] PATH_INFO: `/v3/users/8ebcbd45785049a69e3beb778b891fa6` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:01.982454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ebcbd45785049a69e3beb778b891fa6)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:01.984543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:02.030447 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ebcbd45785049a69e3beb778b891fa6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.031103 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ebcbd45785049a69e3beb778b891fa6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.042659 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ebcbd45785049a69e3beb778b891fa6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.049425 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ebcbd45785049a69e3beb778b891fa6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.050066 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ebcbd45785049a69e3beb778b891fa6'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.061855 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1432/2898] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:38:01 2022] DELETE /identity/v3/users/8ebcbd45785049a69e3beb778b891fa6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:38:02.066937 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82d9d-ae79-4e96-a103-0f11425a9823 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:02.067689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82d9d-ae79-4e96-a103-0f11425a9823 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:02.067689 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82d9d-ae79-4e96-a103-0f11425a9823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:02.086614 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8eb82d9d-ae79-4e96-a103-0f11425a9823 None None] MFA Rules not processed for user `6a0908b00117426e8a0fae922d56155e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:38:02.088453 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8eb82d9d-ae79-4e96-a103-0f11425a9823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:02.146841 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1467/2899] 10.222.0.112 () {58 vars in 962 bytes} [Fri Jun 3 16:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:38:02.157321 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:02.159137 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:02.165857 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:38:02.221597 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c21848-990a-489e-801b-f3c89103adc8 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:02.228004 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479c43c-a8e8-4629-b7ed-23cba72a4602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed487d7f2dde42268c57a5330b6c5b23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:02.229202 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479c43c-a8e8-4629-b7ed-23cba72a4602 service neutron] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:02.229701 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479c43c-a8e8-4629-b7ed-23cba72a4602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:02.230214 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479c43c-a8e8-4629-b7ed-23cba72a4602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:02.245533 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479c43c-a8e8-4629-b7ed-23cba72a4602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:02.246975 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479c43c-a8e8-4629-b7ed-23cba72a4602 service neutron] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:02.256543 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1433/2900] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:38:02.425525 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb82d9d-ae79-4e96-a103-0f11425a9823 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:02.426953 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8eb82d9d-ae79-4e96-a103-0f11425a9823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:02.439022 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb82d9d-ae79-4e96-a103-0f11425a9823 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:02.444060 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:02.444923 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:02.445207 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:02.445488 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] PATH_INFO: `/v3/projects/f3ce985154f5419f9d41595733299955` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:02.446752 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ce985154f5419f9d41595733299955)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:02.449110 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:02.496255 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:38:02.499813 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ce985154f5419f9d41595733299955', 'request_id': 'req-3fc579fe-530b-49c4-883c-c4f32ab3b68b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.506631 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ce985154f5419f9d41595733299955', 'request_id': 'req-3fc579fe-530b-49c4-883c-c4f32ab3b68b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.514179 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ce985154f5419f9d41595733299955', 'request_id': 'req-3fc579fe-530b-49c4-883c-c4f32ab3b68b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.524342 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] The token cache is being invalidate because project f3ce985154f5419f9d41595733299955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:38:02.524627 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.525781 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:02.527324 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1468/2901] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:38:02 2022] DELETE /identity/v3/projects/f3ce985154f5419f9d41595733299955 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:38:12.252336 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=24 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:38:12.521442 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:38:23.516102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479c43c-a8e8-4629-b7ed-23cba72a4602 service neutron] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:23.517569 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-a479c43c-a8e8-4629-b7ed-23cba72a4602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:23.596026 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479c43c-a8e8-4629-b7ed-23cba72a4602 service neutron] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:23.663072 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a75803-e161-4df9-ba24-3881debd2c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:23.663760 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75803-e161-4df9-ba24-3881debd2c62 service nova] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:23.664049 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75803-e161-4df9-ba24-3881debd2c62 service nova] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:23.664328 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75803-e161-4df9-ba24-3881debd2c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:23.666634 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-73a75803-e161-4df9-ba24-3881debd2c62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:23.678889 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a75803-e161-4df9-ba24-3881debd2c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:23.680535 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a75803-e161-4df9-ba24-3881debd2c62 service nova] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:23.692249 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1434/2902] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:38:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:38:27.328392 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:27.329901 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:27.346731 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc579fe-530b-49c4-883c-c4f32ab3b68b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:27.352486 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a650b8d49ad480bb1620209a8b7c6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:27.353132 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:27.353411 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:27.353710 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:27.355681 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:27.368615 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:27.370265 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:27.381793 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1469/2903] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:38:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:38:28.691114 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e856c11-4918-419b-a1c9-6afda0a37621 None None] REQUEST_METHOD: `POST` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:28.691618 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e856c11-4918-419b-a1c9-6afda0a37621 None None] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:28.691739 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e856c11-4918-419b-a1c9-6afda0a37621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:28.709574 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.auth.core [None req-3e856c11-4918-419b-a1c9-6afda0a37621 None None] MFA Rules not processed for user `9b44182e2e5b4b34bd549452c305c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80221) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 16:38:28.710801 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3e856c11-4918-419b-a1c9-6afda0a37621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:28.765560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1435/2904] 10.222.0.112 () {58 vars in 972 bytes} [Fri Jun 3 16:38:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 16:38:28.778462 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:28.779935 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:28.848579 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43410de9-34c2-48a7-a07b-56dcf2618995 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:28.854045 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0251-d80a-46d9-9fc7-f7d547bcecac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e7179f5fe945f4be1ca16263042b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:28.854685 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0251-d80a-46d9-9fc7-f7d547bcecac service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:28.854964 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0251-d80a-46d9-9fc7-f7d547bcecac service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:28.855237 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0251-d80a-46d9-9fc7-f7d547bcecac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:28.863441 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b0251-d80a-46d9-9fc7-f7d547bcecac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:28.864975 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b0251-d80a-46d9-9fc7-f7d547bcecac service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:28.873716 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1470/2905] 10.222.0.112 () {60 vars in 1389 bytes} [Fri Jun 3 16:38:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 03 16:38:35.434492 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e856c11-4918-419b-a1c9-6afda0a37621 None None] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:35.436308 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-3e856c11-4918-419b-a1c9-6afda0a37621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:35.473486 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=100 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:38:35.509102 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e856c11-4918-419b-a1c9-6afda0a37621 None None] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:35.513655 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:35.514528 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:35.514814 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:35.515089 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] PATH_INFO: `/v3/users/6284a65a298b4cb48dec2fcd020d5e4e` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:35.516394 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6284a65a298b4cb48dec2fcd020d5e4e)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:35.518329 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:35.567068 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6284a65a298b4cb48dec2fcd020d5e4e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.567848 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6284a65a298b4cb48dec2fcd020d5e4e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.580312 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6284a65a298b4cb48dec2fcd020d5e4e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.587670 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6284a65a298b4cb48dec2fcd020d5e4e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.588958 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6284a65a298b4cb48dec2fcd020d5e4e'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.605455 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1436/2906] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:38:35 2022] DELETE /identity/v3/users/6284a65a298b4cb48dec2fcd020d5e4e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:38:35.787502 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0251-d80a-46d9-9fc7-f7d547bcecac service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:35.799039 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0251-d80a-46d9-9fc7-f7d547bcecac service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:35.863050 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:35.864528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:35.864969 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:35.865250 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] PATH_INFO: `/v3/projects/8437ba25a58f47bb9eec771562a14c4f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:35.866451 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8437ba25a58f47bb9eec771562a14c4f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:35.868582 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:35.914528 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8437ba25a58f47bb9eec771562a14c4f', 'request_id': 'req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.921371 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8437ba25a58f47bb9eec771562a14c4f', 'request_id': 'req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.928623 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8437ba25a58f47bb9eec771562a14c4f', 'request_id': 'req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.939879 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] The token cache is being invalidate because project 8437ba25a58f47bb9eec771562a14c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:38:35.940166 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.940812 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:35.942377 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1471/2907] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:38:35 2022] DELETE /identity/v3/projects/8437ba25a58f47bb9eec771562a14c4f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:38:35.946621 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:35.948131 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:35.961530 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920be13-bb50-408e-bfa0-26c14c42894a admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:36.028763 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:36.029560 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:36.029845 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:36.030145 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] PATH_INFO: `/v3/users/0d502e6dc27244798ea570c552cd400a` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:36.031398 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d502e6dc27244798ea570c552cd400a)` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:36.033388 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:36.081667 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d502e6dc27244798ea570c552cd400a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.082329 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d502e6dc27244798ea570c552cd400a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.084381 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:38:36.097708 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d502e6dc27244798ea570c552cd400a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.105076 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d502e6dc27244798ea570c552cd400a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.105761 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.notifications [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d502e6dc27244798ea570c552cd400a'} {{(pid=80221) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.119454 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1437/2908] 10.222.0.112 () {58 vars in 1228 bytes} [Fri Jun 3 16:38:35 2022] DELETE /identity/v3/users/0d502e6dc27244798ea570c552cd400a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:38:36.291130 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:38:36.292605 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:38:36.306450 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfe668-ae99-4ff9-bdaf-ca1ad1f186c3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:38:36.310944 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:38:36.375754 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0908b00117426e8a0fae922d56155e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '927da6a6fca54cd4babce7d6546e8b7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:38:36.376650 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:38:36.376934 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:38:36.377211 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] PATH_INFO: `/v3/projects/dac173517701457799b86a70fd8ce406` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:38:36.378430 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac173517701457799b86a70fd8ce406)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:38:36.380378 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:38:36.425443 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac173517701457799b86a70fd8ce406', 'request_id': 'req-52501849-99e0-4ca7-8aad-af66b1de8d7d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.432609 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac173517701457799b86a70fd8ce406', 'request_id': 'req-52501849-99e0-4ca7-8aad-af66b1de8d7d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.440965 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac173517701457799b86a70fd8ce406', 'request_id': 'req-52501849-99e0-4ca7-8aad-af66b1de8d7d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.451783 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] The token cache is being invalidate because project dac173517701457799b86a70fd8ce406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 16:38:36.452071 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.452705 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-52501849-99e0-4ca7-8aad-af66b1de8d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 16:38:36.454492 dv-cinder-836996-28-smb devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1472/2909] 10.222.0.112 () {58 vars in 1237 bytes} [Fri Jun 3 16:38:36 2022] DELETE /identity/v3/projects/dac173517701457799b86a70fd8ce406 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 16:38:46.115860 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=11,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:38:46.448676 dv-cinder-836996-28-smb devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:41:42.628854 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] Authenticating user token {{(pid=80221) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 16:41:42.630431 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:41:42.775534 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37005-5d65-422a-9b59-c3d7cd8c6e96 admin admin] Validating token access rules against request {{(pid=80221) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 16:41:42.836178 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd923dc6-67e5-4e03-b960-a155ed0a676a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88e5d3ba49164f55a063aa60643bd421', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '555515ae5eb24b5fa77ae7712f0470ea', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80221) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 16:41:42.836825 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923dc6-67e5-4e03-b960-a155ed0a676a service placement] REQUEST_METHOD: `GET` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 16:41:42.837104 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923dc6-67e5-4e03-b960-a155ed0a676a service placement] SCRIPT_NAME: `/identity` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 16:41:42.837489 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd923dc6-67e5-4e03-b960-a155ed0a676a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80221) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 16:41:42.839262 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.fernet_utils [None req-fd923dc6-67e5-4e03-b960-a155ed0a676a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80221) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 16:41:42.851063 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd923dc6-67e5-4e03-b960-a155ed0a676a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 16:41:42.852685 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd923dc6-67e5-4e03-b960-a155ed0a676a service placement] RBAC: Authorization granted {{(pid=80221) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 16:41:42.862934 dv-cinder-836996-28-smb devstack@keystone.service[80221]: [pid: 80221|app: 0|req: 1438/2910] 10.222.0.112 () {60 vars in 1370 bytes} [Fri Jun 3 16:41:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 16:41:52.858349 dv-cinder-836996-28-smb devstack@keystone.service[80221]: DEBUG dbcounter [-] [80221] Writing DB stats keystone:SELECT=89 {{(pid=80221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}